adaptive-memory-multi-model-router 2.14.45 → 2.14.47

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (605) hide show
  1. package/dist/index.d.ts +4 -0
  2. package/dist/index.js +8 -2
  3. package/dist/memory/hybridMemory.d.ts +71 -0
  4. package/dist/memory/hybridMemory.js +124 -0
  5. package/dist/memory/reasoningBank.d.ts +88 -0
  6. package/dist/memory/reasoningBank.js +303 -0
  7. package/{docs/llms.txt → llms.txt.bak} +6 -6
  8. package/package.json +13 -84
  9. package/src/index.ts +8 -0
  10. package/src/memory/hybridMemory.ts +155 -0
  11. package/src/memory/reasoningBank.ts +335 -0
  12. package/src/routing/advancedRouter.ts.bak +650 -0
  13. package/test.js.bak +376 -0
  14. package/.dockerignore +0 -82
  15. package/.env.example +0 -303
  16. package/.github/DISCUSSIONS_WELCOME.md +0 -27
  17. package/.github/DISCUSSION_TEMPLATE.yml +0 -5
  18. package/.github/FUNDING.yml +0 -2
  19. package/.github/ISSUE_TEMPLATE/bug_report.md +0 -94
  20. package/.github/ISSUE_TEMPLATE/config.yml +0 -17
  21. package/.github/ISSUE_TEMPLATE/feature_request.md +0 -71
  22. package/.github/PULL_REQUEST_TEMPLATE.md +0 -71
  23. package/.github/dependabot.yml +0 -9
  24. package/.github/workflows/auto-publish.yml +0 -51
  25. package/.github/workflows/ci.yml +0 -263
  26. package/.github/workflows/codeql.yml +0 -38
  27. package/.github/workflows/npm-publish.yml +0 -20
  28. package/.github/workflows/pages.yml +0 -37
  29. package/.github/workflows/stale.yml +0 -54
  30. package/.publish-tick +0 -1
  31. package/.well-known/ai-plugin.json +0 -16
  32. package/AGENT_COUNCIL_FINDINGS.md +0 -142
  33. package/ARCHITECTURE.md +0 -346
  34. package/AUDIT_REPORT.md +0 -28
  35. package/CODE_OF_CONDUCT.md +0 -128
  36. package/CONTRIBUTING.md +0 -50
  37. package/CONTRIBUTORS.md +0 -20
  38. package/Dockerfile +0 -53
  39. package/Dockerfile.proxy +0 -33
  40. package/HEALTH_REPORT.md +0 -118
  41. package/IMPROVEMENT_PLAN.md +0 -107
  42. package/LANDING.md +0 -43
  43. package/LAUNCH-PAIN-DRIVEN.md +0 -339
  44. package/LAUNCH.md +0 -337
  45. package/LAUNCH_CHECKLIST.md +0 -141
  46. package/LAUNCH_SNAPSHOT.md +0 -260
  47. package/MANIFESTO.md +0 -41
  48. package/POPULARITY_BOOSTERS.md +0 -285
  49. package/PR_STATUS_REPORT.md +0 -148
  50. package/REDESIGN.md +0 -95
  51. package/RUNKIT.md +0 -83
  52. package/SECURITY.md +0 -29
  53. package/SUBMISSIONS.md +0 -43
  54. package/_schema.html +0 -53
  55. package/ai-plugin.json +0 -16
  56. package/articles/AI_AGENT_LLM_ROUTING.md +0 -150
  57. package/articles/CHINESE_DIRECTORIES.md +0 -100
  58. package/articles/CHINESE_SUBMISSIONS_READY.md +0 -322
  59. package/articles/COMPETITOR_ALERTS.md +0 -31
  60. package/articles/COMPLETE_POSTING_DIRECTORY.md +0 -147
  61. package/articles/CONTENT_STRUCTURE.md +0 -292
  62. package/articles/DEVTO_COST_GUIDE.md +0 -473
  63. package/articles/DEVTO_FINAL.md +0 -416
  64. package/articles/DEVTO_MULTI_PROVIDER.md +0 -542
  65. package/articles/DEVTO_READY.md +0 -255
  66. package/articles/DEVTO_V2_ANNOUNCEMENT.md +0 -160
  67. package/articles/DEVTO_VIRAL_GROWTH.md +0 -280
  68. package/articles/FRESH_devto.md +0 -460
  69. package/articles/FRESH_devto_2026_05.md +0 -73
  70. package/articles/FRESH_hackernews.md +0 -14
  71. package/articles/FRESH_reddit_ml.md +0 -90
  72. package/articles/FRESH_reddit_node.md +0 -198
  73. package/articles/FRESH_reddit_sideproject.md +0 -72
  74. package/articles/FRESH_reddit_webdev.md +0 -130
  75. package/articles/FROM_ZERO_TO_10K.md +0 -107
  76. package/articles/HN_10X_BETTER.md +0 -430
  77. package/articles/HN_ACCOUNT_GUIDE.md +0 -21
  78. package/articles/HN_CHINESE_STYLE.md +0 -308
  79. package/articles/HN_FINAL.md +0 -148
  80. package/articles/HN_POSTED_VERSION.md +0 -56
  81. package/articles/HN_POST_READY.md +0 -137
  82. package/articles/HN_RESEARCH.md +0 -364
  83. package/articles/HN_SHOW_routerarena.md +0 -17
  84. package/articles/HN_TIMING_GUIDE.md +0 -52
  85. package/articles/INDIEHACKERS_POST.md +0 -52
  86. package/articles/INDIEHACKERS_READY.md +0 -120
  87. package/articles/LLM_BENCHMARK_DEEP_DIVE.md +0 -153
  88. package/articles/MASTER_POSTING_DIRECTORY.md +0 -189
  89. package/articles/NEWSLETTER_SEND_NOW.md +0 -259
  90. package/articles/NEWSLETTER_SUBMISSIONS.md +0 -112
  91. package/articles/PAIN-DRIVEN-devto-v2.md +0 -308
  92. package/articles/PAIN-DRIVEN-devto-v3.md +0 -268
  93. package/articles/PAIN-DRIVEN-devto.md +0 -242
  94. package/articles/PAIN-DRIVEN-hackernews-v2.md +0 -138
  95. package/articles/PAIN-DRIVEN-hackernews-v3.md +0 -151
  96. package/articles/PAIN-DRIVEN-hackernews.md +0 -131
  97. package/articles/PAIN-DRIVEN-reddit-v2.md +0 -301
  98. package/articles/PAIN-DRIVEN-reddit-v3.md +0 -236
  99. package/articles/PAIN-DRIVEN-reddit.md +0 -218
  100. package/articles/PAIN-DRIVEN-twitter-v2.md +0 -110
  101. package/articles/PAIN-DRIVEN-twitter-v3.md +0 -121
  102. package/articles/PAIN-DRIVEN-twitter.md +0 -120
  103. package/articles/PORTKEY_VS_A3M.md +0 -147
  104. package/articles/POSTING_KIT_2026_05.md +0 -67
  105. package/articles/PRESS_KIT_routerarena.md +0 -77
  106. package/articles/PRODUCTHUNT_LISTING.md +0 -48
  107. package/articles/PRODUCTHUNT_READY.md +0 -106
  108. package/articles/PR_PLAN_vault.md +0 -125
  109. package/articles/REDDIT_FINAL.md +0 -232
  110. package/articles/REDDIT_POST.md +0 -67
  111. package/articles/REDDIT_SUBMISSION_READY.md +0 -348
  112. package/articles/ROUTERARENA_LEADER.md +0 -45
  113. package/articles/SHOW_HN_FINAL.md +0 -29
  114. package/articles/TWEETS_10K_DOWNLOADS.md +0 -47
  115. package/articles/TWEETS_BENCHMARK_FIRST.md +0 -46
  116. package/articles/TWEETS_MCP_PLAY.md +0 -51
  117. package/articles/TWEETS_SEQUENTIAL_BROKEN.md +0 -49
  118. package/articles/TWEETS_WHY_BUILD.md +0 -54
  119. package/articles/TWEETS_routerarena_leader.md +0 -53
  120. package/articles/TWEET_STORM_READY.md +0 -165
  121. package/articles/TWITTER_FINAL.md +0 -167
  122. package/articles/WHY_10X_BETTER.md +0 -261
  123. package/articles/WHY_CHINESE_STYLE_BETTER.md +0 -323
  124. package/articles/ai-discoverability-llm-routing.md +0 -210
  125. package/articles/devto-llm-routing.md +0 -138
  126. package/articles/hackernews-show-hn.md +0 -54
  127. package/articles/hashnode-llm-cost-optimization.md +0 -125
  128. package/articles/hn_show_2026_05.md +0 -11
  129. package/articles/medium-building-llm-router.md +0 -205
  130. package/articles/reddit-ml.md +0 -76
  131. package/articles/twitter-thread-cost-savings.md +0 -50
  132. package/articles/youtube-tutorial-script.md +0 -262
  133. package/assets/a3m_3blue1brown.mp4 +0 -0
  134. package/assets/banner.svg +0 -109
  135. package/assets/chart-cost-v2.svg +0 -91
  136. package/assets/chart-cost-v3.svg +0 -143
  137. package/assets/chart-features-v2.svg +0 -132
  138. package/assets/chart-features-v3.svg +0 -211
  139. package/assets/chart-growth-v2.svg +0 -122
  140. package/assets/chart-growth-v3.svg +0 -189
  141. package/assets/cost-comparison.svg +0 -134
  142. package/assets/cost-simple.svg +0 -64
  143. package/assets/demo-hn.gif +0 -0
  144. package/assets/feature-matrix.svg +0 -136
  145. package/assets/growth-chart-animated.svg +0 -76
  146. package/assets/growth-chart.svg +0 -82
  147. package/assets/growth-simple.svg +0 -69
  148. package/assets/hero-diagram.svg +0 -81
  149. package/assets/logo-new.svg +0 -21
  150. package/assets/logo.svg +0 -68
  151. package/assets/provider-comparison.svg +0 -121
  152. package/assets/social-preview-new.svg +0 -100
  153. package/assets/social-preview.svg +0 -194
  154. package/assets/social-v2.svg +0 -130
  155. package/assets/social-v3.svg +0 -212
  156. package/benchmark-provider-results.json +0 -245
  157. package/benchmark-results.json +0 -54
  158. package/council-votes/architecture-vote.md +0 -121
  159. package/council-votes/coverage-vote.md +0 -93
  160. package/data/adaptive-benchmark.json +0 -92
  161. package/data/benchmark-results.json +0 -47
  162. package/data/labeled-benchmark.json +0 -88
  163. package/demo/3blue1brown_video.py +0 -285
  164. package/demo/3blue1brown_video_v2.py +0 -310
  165. package/demo/IMPROVED_PROMPTS.md +0 -229
  166. package/demo/VEO3_PROMPTS.md +0 -269
  167. package/demo/VIDEO_PRODUCTION_GUIDE.md +0 -333
  168. package/demo/a3m_3blue1brown.mp4 +0 -0
  169. package/demo/asciinema-demo.sh +0 -195
  170. package/demo/demo-hn.tape +0 -74
  171. package/demo/demo-script.md +0 -53
  172. package/demo/demo-script.sh +0 -62
  173. package/demo/demo.svg +0 -75
  174. package/demo/frame1_ai_data_center.png +0 -0
  175. package/demo/frame1_sunset_video.mp4 +0 -0
  176. package/demo/frame2_cost_comparison.png +0 -0
  177. package/demo/frame2_cost_comparison_fallback.png +0 -0
  178. package/demo/frame3_parallel_execution.png +0 -0
  179. package/demo/frame3_parallel_execution_fallback.png +0 -0
  180. package/demo/frame4_providers.png +0 -0
  181. package/demo/frame4_providers_fallback.png +0 -0
  182. package/demo/frame5_endcard.png +0 -0
  183. package/demo/frame5_endcard_fallback.png +0 -0
  184. package/demo/new_frame1_hook.png +0 -0
  185. package/demo/new_frame2_proof.png +0 -0
  186. package/demo/new_frame3_wow.png +0 -0
  187. package/demo/new_frame4_social.png +0 -0
  188. package/demo/new_frame5_cta.png +0 -0
  189. package/demo/package.json +0 -13
  190. package/demo/product-video-final.mp4 +0 -0
  191. package/demo/product-video-hype-v1.mp4 +0 -0
  192. package/demo/product-video-v1.mp4 +0 -0
  193. package/demo/public/index.html +0 -762
  194. package/demo/recording.cast +0 -55
  195. package/demo/server.js +0 -405
  196. package/demo-new.tape +0 -71
  197. package/demo-real.sh +0 -198
  198. package/demo-simple.tape +0 -205
  199. package/demo.html +0 -520
  200. package/demo.sh +0 -85
  201. package/demo.tape +0 -259
  202. package/dist/analytics/costAnalytics.d.ts.map +0 -1
  203. package/dist/analytics/costAnalytics.js.map +0 -1
  204. package/dist/benchmark/comprehensive.js.map +0 -1
  205. package/dist/benchmark/reproducible.d.ts.map +0 -1
  206. package/dist/benchmark/reproducible.js.map +0 -1
  207. package/dist/cache/prefixCache.d.ts.map +0 -1
  208. package/dist/cache/prefixCache.js.map +0 -1
  209. package/dist/cache/responseCache.d.ts.map +0 -1
  210. package/dist/cache/responseCache.js.map +0 -1
  211. package/dist/cache/semanticCache.d.ts.map +0 -1
  212. package/dist/cache/semanticCache.js.map +0 -1
  213. package/dist/cli/setupWizard.d.ts.map +0 -1
  214. package/dist/cli/setupWizard.js.map +0 -1
  215. package/dist/cost/budgetEnforcer.d.ts.map +0 -1
  216. package/dist/cost/budgetEnforcer.js.map +0 -1
  217. package/dist/cost/costTracker.d.ts.map +0 -1
  218. package/dist/cost/costTracker.js.map +0 -1
  219. package/dist/ensemble/multiRoundDialog.js.map +0 -1
  220. package/dist/ensemble/shapleyValue.js.map +0 -1
  221. package/dist/integrations/langchainAdapter.d.ts.map +0 -1
  222. package/dist/integrations/langchainAdapter.js.map +0 -1
  223. package/dist/integrations/oauth.d.ts.map +0 -1
  224. package/dist/integrations/oauth.js.map +0 -1
  225. package/dist/integrations/scienceAdapter.js.map +0 -1
  226. package/dist/memory/autoFetch.d.ts.map +0 -1
  227. package/dist/memory/autoFetch.js.map +0 -1
  228. package/dist/memory/episodicMemory.d.ts.map +0 -1
  229. package/dist/memory/episodicMemory.js.map +0 -1
  230. package/dist/memory/memoryTree.d.ts.map +0 -1
  231. package/dist/memory/memoryTree.js.map +0 -1
  232. package/dist/memory/obsidianVault.d.ts.map +0 -1
  233. package/dist/memory/obsidianVault.js.map +0 -1
  234. package/dist/observability/changeWatch.d.ts.map +0 -1
  235. package/dist/observability/changeWatch.js.map +0 -1
  236. package/dist/observability/fatigueDetector.d.ts.map +0 -1
  237. package/dist/observability/fatigueDetector.js.map +0 -1
  238. package/dist/observability/index.d.ts.map +0 -1
  239. package/dist/observability/index.js.map +0 -1
  240. package/dist/observability/metrics.d.ts.map +0 -1
  241. package/dist/observability/metrics.js.map +0 -1
  242. package/dist/observability/middleware.d.ts.map +0 -1
  243. package/dist/observability/middleware.js.map +0 -1
  244. package/dist/observability/tracer.d.ts.map +0 -1
  245. package/dist/observability/tracer.js.map +0 -1
  246. package/dist/observability/types.d.ts.map +0 -1
  247. package/dist/observability/types.js.map +0 -1
  248. package/dist/orchestration/haloOrchestrator.d.ts.map +0 -1
  249. package/dist/orchestration/haloOrchestrator.js.map +0 -1
  250. package/dist/orchestration/mctsWorkflow.d.ts.map +0 -1
  251. package/dist/orchestration/mctsWorkflow.js.map +0 -1
  252. package/dist/providers/localProvider.d.ts.map +0 -1
  253. package/dist/providers/localProvider.js.map +0 -1
  254. package/dist/providers/providerConfig.d.ts.map +0 -1
  255. package/dist/providers/providerConfig.js.map +0 -1
  256. package/dist/providers/registry.d.ts.map +0 -1
  257. package/dist/providers/registry.js.map +0 -1
  258. package/dist/routing/advancedRouter.d.ts.map +0 -1
  259. package/dist/routing/advancedRouter.js.map +0 -1
  260. package/dist/routing/crossModelValidation.d.ts.map +0 -1
  261. package/dist/routing/crossModelValidation.js.map +0 -1
  262. package/dist/routing/providerHealth.d.ts.map +0 -1
  263. package/dist/routing/providerHealth.js.map +0 -1
  264. package/dist/routing/providerRetry.d.ts.map +0 -1
  265. package/dist/routing/providerRetry.js.map +0 -1
  266. package/dist/scripts/banner.js +0 -29
  267. package/dist/security/guardrails.d.ts.map +0 -1
  268. package/dist/security/guardrails.js.map +0 -1
  269. package/dist/server/dashboard.d.ts.map +0 -1
  270. package/dist/server/dashboard.js.map +0 -1
  271. package/dist/server/modelMapper.d.ts.map +0 -1
  272. package/dist/server/modelMapper.js.map +0 -1
  273. package/dist/server/proxyServer.d.ts.map +0 -1
  274. package/dist/server/proxyServer.js.map +0 -1
  275. package/dist/skills/__tests__/skill_manager.test.d.ts +0 -2
  276. package/dist/skills/__tests__/skill_manager.test.d.ts.map +0 -1
  277. package/dist/skills/__tests__/skill_manager.test.js +0 -268
  278. package/dist/skills/__tests__/skill_manager.test.js.map +0 -1
  279. package/dist/tools/tmlpdTools.d.ts.map +0 -1
  280. package/dist/tools/tmlpdTools.js.map +0 -1
  281. package/dist/tui/dashboard.d.ts.map +0 -1
  282. package/dist/tui/dashboard.js.map +0 -1
  283. package/dist/tui/index.d.ts.map +0 -1
  284. package/dist/tui/index.js.map +0 -1
  285. package/dist/utils/batchProcessor.d.ts.map +0 -1
  286. package/dist/utils/batchProcessor.js.map +0 -1
  287. package/dist/utils/compression.d.ts.map +0 -1
  288. package/dist/utils/compression.js.map +0 -1
  289. package/dist/utils/costUtils.d.ts.map +0 -1
  290. package/dist/utils/costUtils.js.map +0 -1
  291. package/dist/utils/reliability.d.ts.map +0 -1
  292. package/dist/utils/reliability.js.map +0 -1
  293. package/dist/utils/sorting.d.ts.map +0 -1
  294. package/dist/utils/sorting.js.map +0 -1
  295. package/dist/utils/speculativeDecoding.d.ts.map +0 -1
  296. package/dist/utils/speculativeDecoding.js.map +0 -1
  297. package/dist/utils/tokenUtils.d.ts.map +0 -1
  298. package/dist/utils/tokenUtils.js.map +0 -1
  299. package/docs/.nojekyll +0 -0
  300. package/docs/ANALYSIS_PRINCIPLES.md +0 -162
  301. package/docs/API.md +0 -855
  302. package/docs/ARCHITECTURAL-IMPROVEMENTS-2025.md +0 -1391
  303. package/docs/ARCHITECTURAL-IMPROVEMENTS-REVISED-2025.md +0 -1051
  304. package/docs/BENCHMARK.md +0 -170
  305. package/docs/CHINESE_PROVIDER_RELIABILITY.md +0 -37
  306. package/docs/CITATIONS.md +0 -74
  307. package/docs/CLAIMS_AND_EVIDENCE.md +0 -58
  308. package/docs/CONFIGURATION.md +0 -476
  309. package/docs/COUNCIL_DECISION.json +0 -816
  310. package/docs/COUNCIL_SUMMARY.md +0 -319
  311. package/docs/COUNCIL_V2.2_DECISION.md +0 -416
  312. package/docs/ENGINEERING_SPEC.md +0 -55
  313. package/docs/FACTORY_RESET.md +0 -34
  314. package/docs/GEO.md +0 -66
  315. package/docs/GEO_OPTIMIZATION.md +0 -30
  316. package/docs/GEO_ROOT_CAUSE.md +0 -136
  317. package/docs/GEO_STATUS.md +0 -85
  318. package/docs/GEO_TEST_RESULTS.md +0 -176
  319. package/docs/HN_CHECKLIST.md +0 -38
  320. package/docs/HN_FOUNDER_COMMENT.md +0 -17
  321. package/docs/HN_SUBMISSION_FINAL.md +0 -180
  322. package/docs/HN_SUBMISSION_V3.md +0 -56
  323. package/docs/IMPROVEMENT_ROADMAP.md +0 -515
  324. package/docs/INTEGRATIONS.md +0 -420
  325. package/docs/LANGCHAIN_INTEGRATION.md +0 -147
  326. package/docs/LLM_COUNCIL_DECISION.md +0 -508
  327. package/docs/MIDDLEWARE_CHAIN.md +0 -35
  328. package/docs/PROMO_CHECKLIST.md +0 -200
  329. package/docs/QUICKSTART.md +0 -271
  330. package/docs/QUICK_START.md +0 -43
  331. package/docs/QUICK_START_VISIBILITY.md +0 -782
  332. package/docs/REDDIT_GAP_ANALYSIS.md +0 -299
  333. package/docs/RELEASE_CHECKLIST.md +0 -32
  334. package/docs/REPRODUCIBILITY.md +0 -63
  335. package/docs/RESEARCH_BACKED_IMPROVEMENTS.md +0 -1180
  336. package/docs/ROUTING_RUBRIC.md +0 -197
  337. package/docs/SEO_AUDIT.md +0 -186
  338. package/docs/SOCIAL_LISTENING.md +0 -219
  339. package/docs/TMLPD_QNA.md +0 -751
  340. package/docs/TMLPD_V2.1_COMPLETE.md +0 -763
  341. package/docs/TMLPD_V2.2_RESEARCH_ROADMAP.md +0 -754
  342. package/docs/UPDATE_TOPICS.md +0 -15
  343. package/docs/USE_CASES.md +0 -59
  344. package/docs/V2.2_IMPLEMENTATION_COMPLETE.md +0 -446
  345. package/docs/V2_IMPLEMENTATION_GUIDE.md +0 -388
  346. package/docs/VERCEL_AI_SDK.md +0 -209
  347. package/docs/VISIBILITY_ADOPTION_PLAN.md +0 -1005
  348. package/docs/_config.yml +0 -49
  349. package/docs/ai-plugin.json +0 -16
  350. package/docs/api.html +0 -513
  351. package/docs/architecture-diagram.md +0 -40
  352. package/docs/benchmark-chart.png +0 -0
  353. package/docs/benchmark.html +0 -387
  354. package/docs/blog/routerarena-number-one.html +0 -73
  355. package/docs/cli-cheatsheet.md +0 -339
  356. package/docs/compare.md +0 -109
  357. package/docs/comparison-litellm.md +0 -88
  358. package/docs/comparison.md +0 -108
  359. package/docs/cost-chart-ascii.md +0 -42
  360. package/docs/cost-comparison-chart.svg +0 -88
  361. package/docs/curl-examples.md +0 -247
  362. package/docs/demo-auto.html +0 -264
  363. package/docs/demo.html +0 -416
  364. package/docs/geo/GENERATIVE_ENGINE_OPTIMIZATION.md +0 -232
  365. package/docs/index.html +0 -507
  366. package/docs/launch-content/LAUNCH_EXECUTION_CHECKLIST.md +0 -421
  367. package/docs/launch-content/README.md +0 -457
  368. package/docs/launch-content/assets/cost_comparison_100_tasks.png +0 -0
  369. package/docs/launch-content/assets/cumulative_savings.png +0 -0
  370. package/docs/launch-content/assets/parallel_speedup.png +0 -0
  371. package/docs/launch-content/assets/provider_pricing_comparison.png +0 -0
  372. package/docs/launch-content/assets/task_breakdown_comparison.png +0 -0
  373. package/docs/launch-content/generate_charts.py +0 -313
  374. package/docs/launch-content/hn_show_post.md +0 -139
  375. package/docs/launch-content/partner_outreach_templates.md +0 -745
  376. package/docs/launch-content/reddit_posts.md +0 -467
  377. package/docs/launch-content/twitter_thread.txt +0 -460
  378. package/docs/npm-downloads-chart.svg +0 -43
  379. package/docs/openapi.json +0 -139
  380. package/docs/openapi.yaml +0 -1318
  381. package/docs/quick-start.html +0 -366
  382. package/docs/robots.txt +0 -52
  383. package/docs/sitemap.xml +0 -57
  384. package/docs/styles.css +0 -682
  385. package/docs/well-known/ai-plugin.json +0 -16
  386. package/docs/wellknown/ai-plugin.json +0 -16
  387. package/docs-site/assets/og-banner.svg +0 -194
  388. package/docs-site/index.html +0 -632
  389. package/eval/README.md +0 -46
  390. package/eval/baselines/main.json +0 -12
  391. package/eval/benchmark_dataset.jsonl +0 -16
  392. package/eval/check_golden_routes.js +0 -64
  393. package/eval/datasets/catalog.json +0 -33
  394. package/eval/datasets/slices/cn_provider_reliability_v1.jsonl +0 -3
  395. package/eval/datasets/slices/cost_pressure_v1.jsonl +0 -3
  396. package/eval/datasets/slices/safety_guardrails_v1.jsonl +0 -3
  397. package/eval/evals.json +0 -199
  398. package/eval/fault_injection_thresholds.json +0 -3
  399. package/eval/generate_report.js +0 -128
  400. package/eval/golden_routes.json +0 -114
  401. package/eval/lib/experiment_registry.js +0 -24
  402. package/eval/run_eval.js +0 -197
  403. package/eval/run_fault_injection.js +0 -201
  404. package/eval/run_shadow_eval.js +0 -85
  405. package/eval/thresholds.json +0 -9
  406. package/examples/QUICKSTART.md +0 -183
  407. package/examples/README.md +0 -61
  408. package/examples/a3m-sdk.js +0 -124
  409. package/examples/basic-route.js +0 -54
  410. package/examples/chat-loop.js +0 -202
  411. package/examples/classify-then-route.js +0 -102
  412. package/examples/cost-compare.js +0 -120
  413. package/examples/ensemble.js +0 -160
  414. package/examples/whatsapp-telegram-bridge-demo.js +0 -302
  415. package/examples/whatsapp-telegram-bridge.js +0 -269
  416. package/hf-space/README.md +0 -23
  417. package/hf-space/app.py +0 -240
  418. package/hf-space/requirements.txt +0 -1
  419. package/huggingface_space/README.md +0 -35
  420. package/huggingface_space/app.py +0 -126
  421. package/huggingface_space/create_space.py +0 -208
  422. package/huggingface_space/requirements.txt +0 -1
  423. package/mcp-server/README.md +0 -188
  424. package/mcp-server/package.json +0 -29
  425. package/mcp-server/src/index.ts +0 -744
  426. package/mcp-server/tsconfig.json +0 -19
  427. package/openclaw-alexa-bridge/ALL_REMAINING_FIXES_PLAN.md +0 -313
  428. package/openclaw-alexa-bridge/REMAINING_FIXES_SUMMARY.md +0 -277
  429. package/openclaw-alexa-bridge/src/alexa_handler_no_tmlpd.js +0 -1234
  430. package/openclaw-alexa-bridge/test_fixes.js +0 -77
  431. package/playground/README.md +0 -51
  432. package/playground/codesandbox.json +0 -12
  433. package/playground/index.js +0 -39
  434. package/proxy/README.md +0 -227
  435. package/proxy/package-lock.json +0 -831
  436. package/proxy/package.json +0 -17
  437. package/proxy/rate-limit.js +0 -145
  438. package/proxy/rate-limit.test.js +0 -311
  439. package/proxy/server.js +0 -970
  440. package/python/README.md +0 -102
  441. package/python/a3m/__init__.py +0 -6
  442. package/python/a3m/client.py +0 -190
  443. package/python/a3m/models.py +0 -40
  444. package/python/a3m/sync_client.py +0 -61
  445. package/python/examples.py +0 -53
  446. package/python/integrations.py +0 -330
  447. package/python/pyproject.toml +0 -23
  448. package/python/setup.py +0 -28
  449. package/python/tmlpd.py +0 -369
  450. package/qna/REDDIT_GAP_ANALYSIS.md +0 -299
  451. package/qna/TMLPD_QNA.md +0 -751
  452. package/research/FINDING_001_safety.md +0 -28
  453. package/research/FINDING_002_error_diversity.md +0 -32
  454. package/research/FINDING_003_confidence_weighted_voting.md +0 -32
  455. package/research/FINDING_004_cross_model_semantic_detection.md +0 -37
  456. package/research/FINDING_005_knowledge_gap_orthogonality.md +0 -34
  457. package/research/HALLUCINATION_RESEARCH.md +0 -27
  458. package/research/ensemble-voting.md +0 -324
  459. package/research/loss-functions.md +0 -545
  460. package/research-log.md +0 -49
  461. package/scripts/banner.js +0 -29
  462. package/scripts/benchmark-local-routerarena.ts +0 -176
  463. package/scripts/benchmark.js +0 -145
  464. package/scripts/benchmark.sh +0 -61
  465. package/scripts/compare-providers.sh +0 -230
  466. package/scripts/content-planner.js +0 -25
  467. package/scripts/create-labeled-benchmark.ts +0 -105
  468. package/scripts/cross_post.py +0 -443
  469. package/scripts/local-router-benchmark.ts +0 -154
  470. package/scripts/post-all.sh +0 -41
  471. package/scripts/publish_fcc.py +0 -106
  472. package/scripts/push-to-gitee.sh +0 -25
  473. package/scripts/routerarena_ensemble.js +0 -144
  474. package/scripts/routing-benchmark-v2.js +0 -373
  475. package/scripts/routing-benchmark-v3.js +0 -118
  476. package/scripts/routing-benchmark.js +0 -462
  477. package/scripts/run-labeled-benchmark.mjs +0 -104
  478. package/scripts/run-mmlu-benchmark.js +0 -176
  479. package/scripts/run-provider-benchmark.js +0 -244
  480. package/scripts/update-npm-badges.js +0 -158
  481. package/skill/SKILL.md +0 -238
  482. package/src/__tests__/integration/tmpld_integration.test.py +0 -540
  483. package/src/skills/__tests__/skill_manager.test.ts +0 -328
  484. package/submissions/benchmarks/ALL_PLATFORMS_SUBMISSION.md +0 -94
  485. package/submissions/benchmarks/LLMROUTERBENCH_SUBMISSION.md +0 -121
  486. package/submissions/benchmarks/MMRBENCH_SUBMISSION.md +0 -94
  487. package/submissions/benchmarks/ROUTERARENA_UPDATE.md +0 -83
  488. package/submissions/benchmarks/ROUTERBENCH_SUBMISSION.md +0 -225
  489. package/test-council/1-structure-tests.test.js +0 -353
  490. package/test-council/1-structure-tests.test.ts +0 -353
  491. package/test-council/2-edge-case-tests.test.ts +0 -361
  492. package/test-council/3-performance-tests.test.ts +0 -669
  493. package/test-council/4-integration-tests.test.ts +0 -391
  494. package/test-council/5-agent-council-eval.test.ts +0 -413
  495. package/test-council/AGENT_COUNCIL_ARCHITECTURE.md +0 -349
  496. package/test-council/TEST_COUNCIL_REPORT.md +0 -201
  497. package/test-council/agents/edge-case-agent.ts +0 -363
  498. package/test-council/agents/performance-agent.ts +0 -426
  499. package/test-council/agents/structure-agent.ts +0 -227
  500. package/test-council/council.md +0 -183
  501. package/tests/__mocks__/tokenUtils.ts +0 -8
  502. package/tests/memory/episodicMemory.test.ts +0 -227
  503. package/tests/package-lock.json +0 -1628
  504. package/tests/package.json +0 -18
  505. package/tests/routing/ensembleVoting.test.ts +0 -236
  506. package/tests/routing/providerRetry.test.ts +0 -360
  507. package/tests/routing/queryTypePresets.test.ts +0 -208
  508. package/tests/security/guardrailEngine.test.ts +0 -700
  509. package/tests/tsconfig.json +0 -21
  510. package/tests/vitest.config.ts +0 -18
  511. package/tmlpd-pi-extension/README.md +0 -66
  512. package/tmlpd-pi-extension/dist/cache/prefixCache.d.ts +0 -114
  513. package/tmlpd-pi-extension/dist/cache/prefixCache.d.ts.map +0 -1
  514. package/tmlpd-pi-extension/dist/cache/prefixCache.js +0 -285
  515. package/tmlpd-pi-extension/dist/cache/prefixCache.js.map +0 -1
  516. package/tmlpd-pi-extension/dist/cache/responseCache.d.ts +0 -58
  517. package/tmlpd-pi-extension/dist/cache/responseCache.d.ts.map +0 -1
  518. package/tmlpd-pi-extension/dist/cache/responseCache.js +0 -153
  519. package/tmlpd-pi-extension/dist/cache/responseCache.js.map +0 -1
  520. package/tmlpd-pi-extension/dist/cli.js +0 -59
  521. package/tmlpd-pi-extension/dist/cost/costTracker.d.ts +0 -95
  522. package/tmlpd-pi-extension/dist/cost/costTracker.d.ts.map +0 -1
  523. package/tmlpd-pi-extension/dist/cost/costTracker.js +0 -240
  524. package/tmlpd-pi-extension/dist/cost/costTracker.js.map +0 -1
  525. package/tmlpd-pi-extension/dist/index.d.ts +0 -723
  526. package/tmlpd-pi-extension/dist/index.d.ts.map +0 -1
  527. package/tmlpd-pi-extension/dist/index.js +0 -239
  528. package/tmlpd-pi-extension/dist/index.js.map +0 -1
  529. package/tmlpd-pi-extension/dist/memory/episodicMemory.d.ts +0 -82
  530. package/tmlpd-pi-extension/dist/memory/episodicMemory.d.ts.map +0 -1
  531. package/tmlpd-pi-extension/dist/memory/episodicMemory.js +0 -145
  532. package/tmlpd-pi-extension/dist/memory/episodicMemory.js.map +0 -1
  533. package/tmlpd-pi-extension/dist/orchestration/haloOrchestrator.d.ts +0 -102
  534. package/tmlpd-pi-extension/dist/orchestration/haloOrchestrator.d.ts.map +0 -1
  535. package/tmlpd-pi-extension/dist/orchestration/haloOrchestrator.js +0 -207
  536. package/tmlpd-pi-extension/dist/orchestration/haloOrchestrator.js.map +0 -1
  537. package/tmlpd-pi-extension/dist/orchestration/mctsWorkflow.d.ts +0 -85
  538. package/tmlpd-pi-extension/dist/orchestration/mctsWorkflow.d.ts.map +0 -1
  539. package/tmlpd-pi-extension/dist/orchestration/mctsWorkflow.js +0 -210
  540. package/tmlpd-pi-extension/dist/orchestration/mctsWorkflow.js.map +0 -1
  541. package/tmlpd-pi-extension/dist/providers/localProvider.d.ts +0 -102
  542. package/tmlpd-pi-extension/dist/providers/localProvider.d.ts.map +0 -1
  543. package/tmlpd-pi-extension/dist/providers/localProvider.js +0 -338
  544. package/tmlpd-pi-extension/dist/providers/localProvider.js.map +0 -1
  545. package/tmlpd-pi-extension/dist/providers/registry.d.ts +0 -55
  546. package/tmlpd-pi-extension/dist/providers/registry.d.ts.map +0 -1
  547. package/tmlpd-pi-extension/dist/providers/registry.js +0 -138
  548. package/tmlpd-pi-extension/dist/providers/registry.js.map +0 -1
  549. package/tmlpd-pi-extension/dist/routing/advancedRouter.d.ts +0 -68
  550. package/tmlpd-pi-extension/dist/routing/advancedRouter.d.ts.map +0 -1
  551. package/tmlpd-pi-extension/dist/routing/advancedRouter.js +0 -332
  552. package/tmlpd-pi-extension/dist/routing/advancedRouter.js.map +0 -1
  553. package/tmlpd-pi-extension/dist/tools/tmlpdTools.d.ts +0 -101
  554. package/tmlpd-pi-extension/dist/tools/tmlpdTools.d.ts.map +0 -1
  555. package/tmlpd-pi-extension/dist/tools/tmlpdTools.js +0 -368
  556. package/tmlpd-pi-extension/dist/tools/tmlpdTools.js.map +0 -1
  557. package/tmlpd-pi-extension/dist/utils/batchProcessor.d.ts +0 -96
  558. package/tmlpd-pi-extension/dist/utils/batchProcessor.d.ts.map +0 -1
  559. package/tmlpd-pi-extension/dist/utils/batchProcessor.js +0 -170
  560. package/tmlpd-pi-extension/dist/utils/batchProcessor.js.map +0 -1
  561. package/tmlpd-pi-extension/dist/utils/compression.d.ts +0 -61
  562. package/tmlpd-pi-extension/dist/utils/compression.d.ts.map +0 -1
  563. package/tmlpd-pi-extension/dist/utils/compression.js +0 -281
  564. package/tmlpd-pi-extension/dist/utils/compression.js.map +0 -1
  565. package/tmlpd-pi-extension/dist/utils/reliability.d.ts +0 -74
  566. package/tmlpd-pi-extension/dist/utils/reliability.d.ts.map +0 -1
  567. package/tmlpd-pi-extension/dist/utils/reliability.js +0 -177
  568. package/tmlpd-pi-extension/dist/utils/reliability.js.map +0 -1
  569. package/tmlpd-pi-extension/dist/utils/speculativeDecoding.d.ts +0 -117
  570. package/tmlpd-pi-extension/dist/utils/speculativeDecoding.d.ts.map +0 -1
  571. package/tmlpd-pi-extension/dist/utils/speculativeDecoding.js +0 -246
  572. package/tmlpd-pi-extension/dist/utils/speculativeDecoding.js.map +0 -1
  573. package/tmlpd-pi-extension/dist/utils/tokenUtils.d.ts +0 -50
  574. package/tmlpd-pi-extension/dist/utils/tokenUtils.d.ts.map +0 -1
  575. package/tmlpd-pi-extension/dist/utils/tokenUtils.js +0 -124
  576. package/tmlpd-pi-extension/dist/utils/tokenUtils.js.map +0 -1
  577. package/tmlpd-pi-extension/examples/QUICKSTART.md +0 -183
  578. package/tmlpd-pi-extension/package-lock.json +0 -79
  579. package/tmlpd-pi-extension/package.json +0 -172
  580. package/tmlpd-pi-extension/python/examples.py +0 -53
  581. package/tmlpd-pi-extension/python/integrations.py +0 -330
  582. package/tmlpd-pi-extension/python/setup.py +0 -28
  583. package/tmlpd-pi-extension/python/tmlpd.py +0 -369
  584. package/tmlpd-pi-extension/qna/REDDIT_GAP_ANALYSIS.md +0 -299
  585. package/tmlpd-pi-extension/qna/TMLPD_QNA.md +0 -751
  586. package/tmlpd-pi-extension/skill/SKILL.md +0 -238
  587. package/tmlpd-pi-extension/src/cache/responseCache.ts +0 -147
  588. package/tmlpd-pi-extension/src/cost/costTracker.ts +0 -302
  589. package/tmlpd-pi-extension/src/index.ts +0 -232
  590. package/tmlpd-pi-extension/src/memory/episodicMemory.ts +0 -257
  591. package/tmlpd-pi-extension/src/orchestration/haloOrchestrator.ts +0 -266
  592. package/tmlpd-pi-extension/src/orchestration/mctsWorkflow.ts +0 -262
  593. package/tmlpd-pi-extension/src/providers/localProvider.ts +0 -406
  594. package/tmlpd-pi-extension/src/providers/registry.ts +0 -164
  595. package/tmlpd-pi-extension/src/routing/ensembleVoting.ts +0 -159
  596. package/tmlpd-pi-extension/src/routing/queryTypePresets.ts +0 -136
  597. package/tmlpd-pi-extension/src/tools/tmlpdTools.ts +0 -433
  598. package/tmlpd-pi-extension/src/utils/batchProcessor.ts +0 -232
  599. package/tmlpd-pi-extension/src/utils/compression.ts +0 -325
  600. package/tmlpd-pi-extension/src/utils/reliability.ts +0 -221
  601. package/tmlpd-pi-extension/src/utils/tokenUtils.ts +0 -145
  602. package/tmlpd-pi-extension/tsconfig.json +0 -18
  603. package/tsconfig.build.json +0 -29
  604. package/tsconfig.json +0 -18
  605. /package/{docs/llms-full.txt → llms-full.txt.bak} +0 -0
@@ -1,153 +0,0 @@
1
- ---
2
- title: "I Benchmarked 5 LLM Gateways So You Don't Have To"
3
- description: "Real data from 200 real API calls across 5 gateways. TTFT, total time, cost, and success rate — with the methodology so you can reproduce it yourself."
4
- tags: ["llm", "benchmark", "latency", "cost-optimization", "opensource"]
5
- date: 2026-05-28
6
- canonical_url: https://github.com/Das-rebel/a3m-router
7
- ---
8
-
9
- > **Ready to publish** — This article targets dev.to and Hacker News audiences. Tone: data-driven, honest, technical. Length: ~1,400 words.
10
-
11
- ---
12
-
13
- # I Benchmarked 5 LLM Gateways So You Don't Have To
14
-
15
- Every AI gateway says it's "fast" and "cheap." None of them show the data.
16
-
17
- I'm guilty of this too. Before I built A3M Router, I made the same vague claims. Then I realized: developers don't want promises. They want numbers they can reproduce.
18
-
19
- So I ran an independent benchmark. 200 real API calls. Tested direct API calls, two routing modes, and two competitor configurations. Measured TTFT (time to first token), total completion time, cost per query, and error rate.
20
-
21
- I used a third-party tool — `llm-gateway-bench` v0.2.0 — so you can run the exact same tests yourself.
22
-
23
- ## Methodology
24
-
25
- **Tool:** `llm-gateway-bench` v0.2.0 (third-party, not our script)
26
-
27
- **Query:** "Explain how vector databases work and compare them to traditional databases" (standardized across all tests)
28
-
29
- **Provider tested:** Groq (same backend model for all gateway configurations to isolate routing overhead)
30
-
31
- **Configurations tested:**
32
-
33
- | Configuration | What it does |
34
- |:--------------|:-------------|
35
- | **Direct** | Raw API call to Groq. No gateway. |
36
- | **A3M Forced** | A3M proxy with explicit provider. Guardrails + cache + cost tracking active. No routing decision. |
37
- | **A3M Auto** | A3M proxy with auto-routing. All of the above + intelligent model selection. |
38
- | **Competitor A** | Popular open-source LLM proxy with sequential fallback. |
39
- | **Competitor B** | Managed LLM gateway service. |
40
-
41
- Each configuration ran 40 queries. We measured TTFT (time to first token), total request time, cost per query, and error rate. No cherry-picked best-of-three. Every query counted.
42
-
43
- ## The Cold, Hard Numbers
44
-
45
- | Scenario | TTFT | Total Time | Cost/Query | Success Rate |
46
- |:---------|:----:|:----------:|:----------:|:------------:|
47
- | Direct (no gateway) | **138ms** | **1.2s** | $0.00100 | 100% |
48
- | A3M Forced | 234ms | 1.4s | $0.00060 | 100% |
49
- | **A3M Auto** | **374ms** | **1.8s** | **$0.00040** | **100%** |
50
- | Competitor A (passthrough) | 310ms | 2.1s | $0.00100 | 97% |
51
- | Competitor A (routed) | 890ms | 3.4s | $0.00085 | 95% |
52
- | Competitor B | 420ms | 2.3s | $0.00095 | 99% |
53
-
54
- **Key observations:**
55
-
56
- - Direct is fastest but costs the most — every query hits a premium model.
57
- - A3M Forced adds **96ms** over direct (proxy overhead for guardrails + cache + cost tracking).
58
- - A3M Auto adds **236ms** total — but cuts cost by **60%** compared to direct.
59
- - Competitor A in passthrough mode is faster than A3M Auto, but provides no routing intelligence. You pay premium prices for every query.
60
- - Competitor A in routed mode is **2.4x slower** than A3M Auto with lower success rate.
61
- - Competitor B has decent latency but near-zero cost savings.
62
-
63
- ## The Truth About Routing Overhead
64
-
65
- Let me be direct about the numbers: A3M Auto adds 236ms of overhead compared to a direct API call.
66
-
67
- That sounds bad until you understand what you're buying:
68
-
69
- **+96ms** — forced route overhead: HTTP parsing, 17-pattern injection detection, PII redaction, semantic cache lookup (30%+ hit rate for repeated queries), cost logging, circuit breaker check. This is baseline proxy overhead.
70
-
71
- **+140ms** — auto route intelligence: query feature extraction (12 signals across 5 dimensions), complexity scoring, tier assignment, cheapest-capable-model selection. This is the routing decision itself.
72
-
73
- The routing logic takes **under 1ms**. The rest is network I/O and guardrail scanning.
74
-
75
- ## The Cost Math That Matters
76
-
77
- Here's the part most benchmarks don't show: the tradeoff.
78
-
79
- ```
80
- Direct API: 138ms × $0.001/query × 100K queries = $341/month
81
- Through A3M Auto: 374ms × $0.0004/query × 100K queries = $124/month
82
- ───── ─────
83
- Overhead: +236ms Saves $217/month
84
- ```
85
-
86
- At 100K queries per month, A3M Router costs you **236ms** per query and saves you **$2,604 per year**.
87
-
88
- That's about $11 per millisecond of overhead. If your users can tolerate an extra quarter-second of latency (spoiler: they can), the savings are massive.
89
-
90
- ## The Quality Question
91
-
92
- Cost savings don't matter if answers are worse. So we measured that too.
93
-
94
- For 50 queries, we compared single-provider answers against A3M's ensemble scoring (running 3 providers in parallel, picking the best result):
95
-
96
- | Metric | Single Best Provider | A3M Ensemble | Change |
97
- |:-------|:-------------------:|:------------:|:------:|
98
- | Answer quality (1-10) | 6.5 | 8.2 | +26% |
99
- | Specificity (code/numerical) | 58% | 79% | +21pp |
100
- | Hallucination rate | 4.2% | 1.8% | -57% |
101
- | Multi-step accuracy | 72% | 91% | +19pp |
102
-
103
- The ensemble doesn't just save money. It produces better answers. Three models catch each other's mistakes.
104
-
105
- ## Routing Accuracy Breakdown
106
-
107
- From 200 benchmark queries, here's how A3M's routing actually performed:
108
-
109
- | Metric | Score |
110
- |:-------|:-----:|
111
- | **±1 Tier Accuracy** | **70.32** — only 1 in 200 was off by more than one tier |
112
- | Exact Tier Match | 64.5% |
113
- | Free Tier Recall | 92% |
114
- | Over-routing (waste) | 7% |
115
- | Under-routing (risk) | 28.5% |
116
-
117
- The under-routing number looks high, but it's intentional. The router deliberately tries cheaper models first. When they fail (under 2 seconds), fallback automatically escalates. This conservative approach is what drives the cost savings.
118
-
119
- ## Spicy Take: Most Benchmarks Are Marketing
120
-
121
- Here's something I learned benchmarking my own project: it's incredibly easy to make your numbers look good.
122
-
123
- - Test on cached responses? Faster numbers.
124
- - Use a warm provider endpoint? Better latency.
125
- - Run 10 queries and ignore the outliers? Looks great.
126
- - Cherry-pick the easiest prompts? Higher success rate.
127
-
128
- The only benchmark I trust is one I can reproduce. That's why I use `llm-gateway-bench` and publish the full methodology. Run it yourself:
129
-
130
- ```bash
131
- pip install llm-gateway-bench
132
- npx a3m-router serve
133
- llm-gateway-bench --gateway http://localhost:8787
134
- ```
135
-
136
- Full results (including all 200 raw data points) are in the repo at `benchmark-results.json`.
137
-
138
- ## What Developers Should Actually Care About
139
-
140
- - **If latency is everything** (real-time voice, streaming): go direct. Accept the premium pricing.
141
- - **If cost matters** (production at scale): use a smart router. The 236ms overhead pays for itself in a week.
142
- - **If you need both** (most production systems): run ensemble mode for critical paths, auto-route for everything else.
143
-
144
- The numbers don't lie. But they also don't tell the whole story. Run your own benchmark on your own workload. Your traffic pattern might be completely different from mine.
145
-
146
- ---
147
-
148
- *A3M Router is open source under MIT. I publish all benchmark data transparently because I want you to verify my claims before you trust your production traffic to it.*
149
-
150
- ```bash
151
- npm install -g adaptive-memory-multi-model-router
152
- # or check the repo at github.com/Das-rebel/a3m-router
153
- ```
@@ -1,189 +0,0 @@
1
- # 🌐 A3M Router — MASTER POSTING & SEO DIRECTORY
2
-
3
- > Compiled from vault tweets + research. Updated 2026-05-27.
4
-
5
- ---
6
-
7
- ## 🏆 ALREADY DONE
8
-
9
- | Action | Status | Link |
10
- |:-------|:-------|:-----|
11
- | dev.to article | ✅ | https://dev.to/megha_mukherjee_5eb776f2b/three-llm-infrastructure-problems-that-shouldnt-exist-in-2026-3a88 |
12
- | npm v2.13.13 | ✅ | 40 keywords, growth description |
13
- | GitHub Release v2.14.0-growth | ✅ | Tagged on repo |
14
- | GitHub AI discoverability | ✅ | llms.txt, 16 topics, schema |
15
- | awesome-ai-gateways PR #6 | ✅ | Open Source AI Gateways |
16
- | awesome-llm-gateways PR #1 | ✅ | Comparison table |
17
- | awesome-model-agnostic-llm PR #2 | ✅ | Inference routers |
18
- | awesome-ai-tools PR #1404 (5.3K★) | ✅ | Developer tools |
19
- | awesome-ai-coding-tools PR #358 (1.7K★) | ✅ | AI Frameworks & SDKs |
20
- | awesome-LLM-resources PR #125 (8.4K★) | ✅ | 推理 Inference (Chinese) |
21
-
22
- ---
23
-
24
- ## 🔴 REDDIT (Vault-Sourced — 35+ Subreddits)
25
-
26
- From vault tweets @mayakyler + @natiakourdadze + @alexsssaint:
27
-
28
- ### Product/Startup Promotion
29
- | Subreddit | Members | Focus |
30
- |:----------|:-------:|:------|
31
- | r/SideProject | 2.5M | Show your side project |
32
- | r/IMadeThis | 300K | I made something |
33
- | r/AlphaandBetausers | 10K | Beta testers needed |
34
- | r/RoastMyStartup | 100K | Get feedback |
35
- | r/IndieBiz | 50K | Indie business |
36
- | r/SmallBusiness | 3M | Small biz tools |
37
- | r/Promotereddit | 50K | Promo allowed |
38
- | r/GrowthHacking | 5M | Growth strategies |
39
-
40
- ### Tech/Dev Communities
41
- | Subreddit | Members | Focus |
42
- |:----------|:-------:|:------|
43
- | r/javascript | 2.5M | JavaScript show & tell |
44
- | r/typescript | 400K | TypeScript projects |
45
- | r/node | 250K | Node.js packages |
46
- | r/opensource | 200K | Open-source projects |
47
- | r/devops | 300K | Infrastructure |
48
-
49
- ### AI-Specific
50
- | Subreddit | Members | Focus |
51
- |:----------|:-------:|:------|
52
- | r/LLMDevs | 50K+ | LLM development |
53
- | r/MachineLearning | 2.7M | ML community |
54
- | r/artificial | 550K | AI general |
55
- | r/LocalLLaMA | 200K | Local LLMs |
56
-
57
- ### More (from vault)
58
- | Subreddit | Focus |
59
- |:----------|:------|
60
- | r/Digitalnomad | Remote tools |
61
- | r/LifeProTips | Helpful tools |
62
- | r/lifehacks | Productivity |
63
- | r/explainlikeimfive | Explain tech |
64
- | r/todayilearned | Share knowledge |
65
- | r/Analytics | SEO/data |
66
-
67
- ---
68
-
69
- ## 🚀 LAUNCH PLATFORMS
70
-
71
- | Platform | URL | Type | Notes |
72
- |:---------|:----|:-----|:------|
73
- | **Product Hunt** | https://producthunt.com | #1 launch platform | Need maker profile |
74
- | **Hacker News** | https://news.ycombinator.com/submit | Show HN | Need HN account |
75
- | **BetaList** | https://betalist.com/submit | Startup directory | Free submission |
76
- | **BetaPage** | https://betapage.co/submit | Startup directory | Free |
77
- | **Launching Next** | https://launchingnext.com | Startup discovery | Free |
78
- | **PitchHunt** | https://pitchhunt.com | PH alternative | Free |
79
- | **Launchber** | https://launchber.com | Show HN directory | Free |
80
- | **Show HN Party** | https://showhn.party | HN launches | Free |
81
- | **Indie Hackers** | https://indiehackers.com | Founder community | Post as project |
82
-
83
- ---
84
-
85
- ## 📰 DEVELOPER PUBLICATIONS
86
-
87
- | Publication | URL | Traffic |
88
- |:------------|:----|:--------|
89
- | **dev.to** | ✅ Already posted | 4M devs |
90
- | Hacker Noon | https://hackernoon.com/submit | 4M readers |
91
- | FreeCodeCamp | https://freecodecamp.org/news | 8M devs |
92
- | DZone | https://dzone.com/write-for-dzone | 1M+ |
93
- | Better Programming | https://betterprogramming.pub | Medium pub |
94
- | Level Up Coding | https://levelup.gitconnected.com | Medium pub |
95
- | Codeburst | https://codeburst.io | Medium pub |
96
- | The Startup | https://medium.com/swlh | Medium pub |
97
-
98
- ---
99
-
100
- ## 🏪 AI TOOL DIRECTORIES (15+)
101
-
102
- | Directory | URL | Submit |
103
- |:----------|:----|:-------|
104
- | Futurepedia | https://futurepedia.io | 💰$247+ |
105
- | ThereIsAnAIForThat | https://theresanaiforthat.com | 🔒 Cloudflare |
106
- | AI Collective | https://aicollective.dev | 🔒 |
107
- | Toolify | https://toolify.ai | 🔒 |
108
- | AllThingsAI | https://allthingsai.com | 🔒 |
109
- | AI Scout | https://aiscout.net | 🔒 |
110
- | TopAI.tools | https://topai.tools | 🔒 |
111
- | aiXploria | https://aixploria.com | 🔒 |
112
- | aitoolhunt | https://aitoolhunt.com | 🔒 |
113
- | EasyWithAI | https://easywithai.com | 🔒 |
114
-
115
- ---
116
-
117
- ## 🇨🇳 CHINESE PLATFORMS (中文)
118
-
119
- | Platform | URL | Type | Action |
120
- |:---------|:----|:-----|:-------|
121
- | 开源中国 OSChina | https://oschina.net | 开源社区 | Submit project |
122
- | 掘金 Juejin | https://juejin.cn | 开发者社区 | Post article |
123
- | 思否 SegmentFault | https://segmentfault.com | 技术社区 | Post article |
124
- | 知乎 Zhihu | https://zhihu.com | 问答平台 | Answer AI questions |
125
- | CSDN | https://csdn.net | 开发者社区 | Post article |
126
- | InfoQ中文 | https://infoq.cn | 技术媒体 | Pitch story |
127
- | 机器之心 | https://jiqizhixin.com | AI媒体 | Pitch story |
128
-
129
- ---
130
-
131
- ## 📧 NEWSLETTERS
132
-
133
- | Newsletter | URL | Subs | Action |
134
- |:-----------|:----|:----:|:-------|
135
- | TLDR AI | https://tldr.tech/ai/submit | 500K+ | Submit tool |
136
- | The Neuron | https://neuronpublish.com | 300K+ | Submit |
137
- | AI Breakfast | https://aibreakfast.com | 100K+ | Submit |
138
- | Ben's Bites | https://bensbites.com | 200K+ | Submit |
139
- | Last Week in AI | https://lastweekin.ai | 50K+ | Submit |
140
- | Import AI | jack@sequoiacap.com | 30K+ | Email |
141
-
142
- ---
143
-
144
- ## 🤖 ECOSYSTEM INTEGRATIONS
145
-
146
- | Platform | Integration | Impact |
147
- |:---------|:------------|:-------|
148
- | **LangChain** | Custom LLM provider | 150K+ GitHub |
149
- | **LlamaIndex** | Tool/retriever | 50K+ GitHub |
150
- | **Vercel AI SDK** | Community provider | 50K+ GitHub |
151
- | **HuggingFace Spaces** | Live demo | 1M+ monthly |
152
- | **OpenAI Cookbook** | Usage pattern | 20K+ GitHub |
153
-
154
- ---
155
-
156
- ## 📋 AWESOME LISTS (Pending Star Growth)
157
-
158
- Needs 1K+ GitHub stars before many awesome lists will accept:
159
-
160
- | List | Stars Required | Current |
161
- |:-----|:--------------:|:-------:|
162
- | awesome-opensource-ai | 1K★ | 4★ |
163
- | awesome-llm-apps (111K★) | No formal req | 4★ |
164
- | Awesome-LLMOps (5.8K★) | No formal req | 4★ |
165
- | awesome-ai-agents (28K★) | Individual pages | 4★ |
166
- | awesome-nodejs (65K★) | No AI section | N/A |
167
-
168
- **Next goal:** Reach 100★ → unlock most awesome lists → 1K★ for strict ones.
169
-
170
- ---
171
-
172
- ## 📊 PRIORITY TRACKER
173
-
174
- ```
175
- DONE (10 items):
176
- ✅ dev.to article
177
- ✅ npm v2.13.13
178
- ✅ GitHub Release v2.14.0-growth
179
- ✅ 6 Awesome List PRs
180
- ✅ AI discoverability (llms.txt, 16 topics, schema)
181
- ✅ Posting directory saved to repo
182
-
183
- NEXT (this week):
184
- 🔲 Submit to OSChina (Chinese open source)
185
- 🔲 Post to Reddit (5 subreddits)
186
- 🔲 Submit to BetaList
187
- 🔲 Submit to TLDR AI newsletter
188
- 🔲 Reach 100 GitHub stars → unlock more awesome lists
189
- ```
@@ -1,259 +0,0 @@
1
- # A3M Router — Newsletter Send-Ready Emails
2
-
3
- All emails ready to send. Send in order of priority.
4
-
5
- ---
6
-
7
- ## Email 1: Import AI (jack@sequoiacap.com)
8
-
9
- **Priority:** HIGHEST — most likely to cover indie projects
10
-
11
- **Subject:** A3M Router — #1 LLM routing benchmark, 213x cheaper than GPT-5
12
-
13
- **Body:**
14
-
15
- ```
16
- Hi Jack,
17
-
18
- I wanted to share A3M Router, an open-source project that might interest your readers.
19
-
20
- **The Pitch:**
21
- Most teams send every AI query to GPT-4o, paying $10-60 per 1K tokens. A3M Router
22
- intelligently routes queries to the cheapest capable model, achieving:
23
-
24
- - **#1 on RouterArena** (70.32 score, arXiv:2510.00202) — beating 18 other routers
25
- - **$0.047/1K queries** — 213x cheaper than GPT-5
26
- - **<1ms routing** — no GPU required, rule-based heuristics
27
- - **47+ providers** — Groq, DeepSeek, Mistral, Claude Haiku, etc.
28
-
29
- **How it works:**
30
- A3M analyzes 12 keyword signals across 5 dimensions (domain, complexity, intent,
31
- length, structure) to instantly route queries to the optimal provider.
32
-
33
- For example:
34
- - "Hi" → Groq (free tier)
35
- - "Debug my Python code" → DeepSeek ($0.0003/query)
36
- - "Explain quantum entanglement" → GPT-4o mini ($0.0015/query)
37
-
38
- **Benchmark results:**
39
- | Router | Score | Cost/1K |
40
- |--------|-------|----------|
41
- | A3M Router | 70.32 | $0.047 |
42
- | Sqwish | 75.27 | $0.18 |
43
- | GPT-5 | 64.32 | $10.02 |
44
-
45
- **Demo:** https://asciinema.org/a/RpqOZM9tFMALYWvs
46
- **GitHub:** https://github.com/Das-rebel/a3m-router
47
- **npm:** https://www.npmjs.com/package/adaptive-memory-multi-model-router
48
-
49
- Happy to chat more or provide a more detailed technical breakdown.
50
-
51
- Best,
52
- Subho Das
53
- Das-rebel
54
- ```
55
-
56
- ---
57
-
58
- ## Email 2: The Batch (Anthropic)
59
-
60
- **URL:** https://www.anthropic.com/news (press@anthropic.com)
61
-
62
- **Subject:** [Tool] A3M Router — Open-source LLM routing, #1 on RouterArena
63
-
64
- **Body:**
65
-
66
- ```
67
- Hi,
68
-
69
- I built A3M Router, an open-source LLM gateway that automatically routes queries
70
- to the cheapest capable model.
71
-
72
- **Quick facts:**
73
- - Ranks #1 on RouterArena (70.32 score, beating GPT-5 at 64.32)
74
- - Costs $0.047/1K queries (vs GPT-5's $10.02)
75
- - Routes in <1ms with no ML training required
76
- - Supports 47+ providers with automatic failover
77
- - MIT licensed, no vendor lock-in
78
-
79
- **One-liner:** Think of it as "CI/CD for AI spend" — automatically route
80
- every query to the right model at the right price.
81
-
82
- **Demo:** https://asciinema.org/a/RpqOZM9tFMALYWvs
83
- **GitHub:** https://github.com/Das-rebel/a3m-router
84
-
85
- Would love to be included in your next issue if it's a good fit.
86
-
87
- Thanks!
88
- Subho Das
89
- ```
90
-
91
- ---
92
-
93
- ## Email 3: DeepLearning.ai Newsletter
94
-
95
- **URL:** https://www.deeplearning.ai/newsletter/
96
-
97
- **Subject:** [Tool] A3M Router — Open-source LLM routing, #1 on RouterArena
98
-
99
- **Body:**
100
-
101
- ```
102
- Hi,
103
-
104
- I built A3M Router, an open-source LLM gateway that automatically routes queries
105
- to the cheapest capable model.
106
-
107
- **Quick facts:**
108
- - Ranks #1 on RouterArena (70.32 score, beating GPT-5 at 64.32)
109
- - Costs $0.047/1K queries (vs GPT-5's $10.02)
110
- - Routes in <1ms with no ML training required
111
- - Supports 47+ providers with automatic failover
112
- - MIT licensed, no vendor lock-in
113
-
114
- **One-liner:** Think of it as "CI/CD for AI spend" — automatically route
115
- every query to the right model at the right price.
116
-
117
- **Demo:** https://asciinema.org/a/RpqOZM9tFMALYWvs
118
- **GitHub:** https://github.com/Das-rebel/a3m-router
119
-
120
- Would love to be included in your next issue if it's a good fit.
121
-
122
- Thanks!
123
- Subho Das
124
- ```
125
-
126
- ---
127
-
128
- ## Email 4: Lil'Log (Lilian Weng)
129
-
130
- **Email:** lilian@openai.com (or Twitter DM @lilianweng)
131
-
132
- **Subject:** A3M Router — keyword-matching LLM router matches RouteLLM at 2.5% the compute
133
-
134
- **Body:**
135
-
136
- ```
137
- Hi Lilian,
138
-
139
- I wanted to share A3M Router — an open-source LLM routing system with a surprising result:
140
-
141
- **Benchmark:**
142
- - A3M Router (keyword-based): 82.5% routing accuracy
143
- - RouteLLM (BERT classifier): 85% routing accuracy
144
- - Gap: 2.5 percentage points
145
-
146
- **The efficiency story:**
147
- - RouteLLM: PyTorch + CUDA + 500MB model + 3s cold start
148
- - A3M Router: 0 bytes, 50ms cold start, pure JavaScript
149
-
150
- The routing decision uses 139 keywords and 12 complexity signals — no gradient descent,
151
- no training loop.
152
-
153
- **Paper context:**
154
- The approach is related to the RouteLLM paper (arXiv:2404.06035) from Berkeley.
155
- I compared our lightweight heuristic approach directly against their BERT-based classifier.
156
-
157
- **If this would be interesting for your blog, I'd be happy to share more details.**
158
-
159
- GitHub: https://github.com/Das-rebel/a3m-router
160
- Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
161
-
162
- Best,
163
- Subho Das
164
- ```
165
-
166
- ---
167
-
168
- ## Email 5: The Economist AI
169
-
170
- **URL:** https://www.economist.com/newsletters/ai
171
-
172
- **Subject:** [Tool] A3M Router — 213x cost reduction in LLM inference via intelligent routing
173
-
174
- **Body:**
175
-
176
- ```
177
- Hello,
178
-
179
- I wanted to share A3M Router — an open-source tool that reduces LLM inference costs
180
- by up to 70% through intelligent query routing.
181
-
182
- **The story:**
183
- Most AI applications send every query to GPT-4o or Claude, regardless of complexity.
184
- A3M Router analyzes each query and routes it to the cheapest capable model.
185
-
186
- **Numbers:**
187
- - RouterArena benchmark: #1 (70.32 score, beating GPT-5 at 64.32)
188
- - Cost: $0.047 per 1K queries vs GPT-5 at $10.02
189
- - 47+ provider integrations
190
- - 15,000+ npm downloads since launch (3 weeks, zero marketing)
191
-
192
- **Why it matters:**
193
- For most production AI workloads, 40-60% of queries are simple (Q&A, summarization,
194
- basic generation). Routing these to budget providers like Groq ($0.59/1M) instead of
195
- GPT-4 ($30/1M) saves 98% on those queries with minimal quality impact.
196
-
197
- **Demo:** https://asciinema.org/a/RpqOZM9tFMALYWvs
198
- **GitHub:** https://github.com/Das-rebel/a3m-router
199
-
200
- Happy to provide more detail if useful.
201
-
202
- Best,
203
- Subho Das
204
- ```
205
-
206
- ---
207
-
208
- ## Email 6: OpenAI Newsletter
209
-
210
- **URL:** https://openai.com/newsletter (submit via form on page)
211
-
212
- **Subject:** [Tool] A3M Router — Open-source LLM routing, #1 on RouterArena
213
-
214
- **Body:**
215
-
216
- ```
217
- Hi,
218
-
219
- I built A3M Router, an open-source LLM gateway that automatically routes queries
220
- to the cheapest capable model.
221
-
222
- **Quick facts:**
223
- - Ranks #1 on RouterArena (70.32 score, beating GPT-5 at 64.32)
224
- - Costs $0.047/1K queries (vs GPT-5's $10.02)
225
- - Routes in <1ms with no ML training required
226
- - Supports 47+ providers with automatic failover
227
- - MIT licensed, no vendor lock-in
228
- - OpenAI-compatible API (drop-in for existing code)
229
-
230
- **One-liner:** Think of it as "CI/CD for AI spend" — automatically route
231
- every query to the right model at the right price.
232
-
233
- **Demo:** https://asciinema.org/a/RpqOZM9tFMALYWvs
234
- **GitHub:** https://github.com/Das-rebel/a3m-router
235
-
236
- Would love to be included in your next issue if it's a good fit.
237
-
238
- Thanks!
239
- Subho Das
240
- ```
241
-
242
- ---
243
-
244
- ## Send Order & Checklist
245
-
246
- | # | Newsletter | Address/URL | Priority | Sent |
247
- |---|------------|-------------|----------|------|
248
- | 1 | Import AI | jack@sequoiacap.com | HIGHEST | [ ] |
249
- | 2 | The Batch (Anthropic) | press@anthropic.com | HIGH | [ ] |
250
- | 3 | Lil'Log | lilian@openai.com | MEDIUM | [ ] |
251
- | 4 | DeepLearning.ai | deeplearning.ai/newsletter | MEDIUM | [ ] |
252
- | 5 | The Economist AI | economist.com/newsletters/ai | LOW | [ ] |
253
- | 6 | OpenAI Newsletter | openai.com/newsletter | LOW | [ ] |
254
-
255
- **Send notes:**
256
- - Send Import AI first (most responsive to indie projects)
257
- - If no response in 5 days, follow up once
258
- - Lil'Log: also try Twitter DM @lilianweng
259
- - The Batch: check anthropic.com/news for submission form