adaptive-memory-multi-model-router 2.12.4 → 2.12.7

package/Awesome-LLM/contributing.md

@@ -1,24 +0,0 @@
-# Contribution Guidelines
-
-To add, remove, or change things on this repository please submit a pull request that adheres to the following guidelines:
-
-- To add a paper in **Milestone Papers**, please mention why it is important in LLM literature and sort the papers in chronological order. 
-- Models in **LLM Leaderboard** should be sorted by their model size.
-- Please follow the existing format to add new terms.
-
-Thank you for your suggestions!
-
-## Updating your PR
-
-A lot of times, making a PR adhere to the standards above can be difficult.
-If the maintainers notice anything that we'd like changed, we'll ask you to
-edit your PR before we merge it. There's no need to open a new PR, just edit
-the existing one. If you're not sure how to do that,
-[here is a guide](https://github.com/RichardLitt/knowledge/blob/master/github/amending-a-commit-guide.md)
-on the different ways you can update your PR so that we can merge it.
-
-## how to add dynamic citation badge
-
-1. get paper id from semantic scholar paper page 
-2. create dynamic badge at [this site](https://shields.io/badges/dynamic-json-badge) with this link: https://api.semanticscholar.org/graph/v1/paper/{paper_id}?fields=citationCount
-3. ![Dynamic JSON Badge](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fapi.semanticscholar.org%2Fgraph%2Fv1%2Fpaper%2F432bef8e34014d726c674bc458008ac895297b51%3Ffields%3DcitationCount&query=%24.citationCount&label=citation)

package/Awesome-LLM/paper_list/RLHF.md

@@ -1 +0,0 @@
-## 

package/Awesome-LLM/paper_list/Retrieval_Augmented_Generation.md

@@ -1,6 +0,0 @@
-# Retrieval-Augmented Generation
-> Retrieval-Augmented Generation (RAG) combines a retriever model to fetch relevant documents from a corpus and a generator model to produce responses based on both the retrieved documents and the original input, enhancing the generation with external knowledge.
-
-## Useful Resource
-- [Retrieval-Augmented Generation_Paper](https://arxiv.org/abs/2005.11401v4) - The Original Paper on RAG published by Meta in 2020.
-- [Retrieval-Augmented Geneartion Survey](https://arxiv.org/pdf/2312.10997.pdf) - A Comprehensive and High-quality Survey Conducted by Tongji University and Fudan University on RAG in 2023.

package/Awesome-LLM/paper_list/acceleration.md

@@ -1,10 +0,0 @@
-# Acceleration
-> Hardware and software acceleration for LLM training and inference
-
-## Papers
-
-### 2023
-
-- (2023-02)  **High-throughput Generative Inference of Large Language Models with a single GPU** Ying Sheng et al. [Paper](https://github.com/FMInference/FlexGen/blob/main/docs/paper.pdf) | [Github](https://github.com/FMInference/FlexGen)
-
-## Useful Resources

package/Awesome-LLM/paper_list/alignment.md

@@ -1,20 +0,0 @@
-# Alignment
-
-## Papers
-
-### 2023
-
-- (2023-08) **Aligning Large Language Models with Human: A Survey** [paper](https://arxiv.org/abs/2307.12966)
-- (2023-05) **LIMA: Less Is More for Alignment** [paper](https://arxiv.org/abs/2305.11206)
-
-- (2023-05) **RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs** [paper](https://arxiv.org/abs/2305.08844)
-
-- (2023-05) **Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision** [paper](https://arxiv.org/abs/2305.03047)
-
-- (2023-05) **Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedback** [paper](https://arxiv.org/abs/2305.10142)
-
-- (2023-04) **Fundamental Limitations of Alignment in Large Language Models** [paper](https://arxiv.org/abs/2304.11082)
-
-## Useful Resources
-- [Awesome-Align-LLM-Human](https://github.com/GaryYufei/AlignLLMHumanSurvey) - A collection of papers and resources about aligning large language models (LLMs) with human.
-

package/Awesome-LLM/paper_list/application.md

@@ -1,19 +0,0 @@
-# Application
-
-> Use LLM to do some really cool stuff
-
-## Papers
-
-### 2022
-
-- (2022-10) **Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing** [paper](https://arxiv.org/abs/2210.13669)
-
-### 2023
-
-- (2023-03) **Mixture of Soft Prompts for Controllable Data Generation** [paper](https://arxiv.org/pdf/2303.01580.pdf)
-- (2023-03) **FaceChat: An Emotion-Aware Face-to-face Dialogue Framework** [paper](https://arxiv.org/abs/2303.07316)
-- (2023-03) **Large Language Models in the Workplace: A Case Study on Prompt Engineering for Job Type Classification** [paper](https://arxiv.org/abs/2303.07142)
-- (2023-06) **SMILE: Single-turn to Multi-turn Inclusive Language Expansion via ChatGPT for Mental Health Support** [paper](https://arxiv.org/pdf/2305.00450.pdf) | [code](https://github.com/qiuhuachuan/smile)
-
-## Useful Resources
-

package/Awesome-LLM/paper_list/augmentation.md

@@ -1,14 +0,0 @@
-# Augmentation
-
-## Papers
-
-### 2023
-
-- (2023-01) **REPLUG: Retrieval-Augmented Black-Box Language Models** [paper](https://arxiv.org/abs/2301.12652)
-- (2023-02) **Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback** [paper](https://arxiv.org/abs/2302.12813)
-- (2023-02) **Augmented Language Models: a Survey** [paper](https://arxiv.org/abs/2302.07842)
-- (2023-03) **Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback** [paper](https://arxiv.org/abs/2303.05453)
-- (2023-03) **Reflexion: an autonomous agent with dynamic memory and self-reflection** [paper](https://arxiv.org/abs/2303.11366)
-- (2023-04) **Scaling Transformer to 1M tokens and beyond with RMT** [paper](https://arxiv.org/abs/2304.11062)
-
-## Useful Resources

package/Awesome-LLM/paper_list/chain_of_thougt.md

@@ -1,16 +0,0 @@
-# Chain-of-Thought
-
-> Chain of thought—a series of intermediate reasoning steps—significantly improves the ability of large language models to perform complex reasoning.
-
-## Papers
-
-### 2021
-
-- (2021-01) **Chain of Thought Prompting Elicits Reasoning in Large Language Models.**  [paper](https://arxiv.org/abs/2201.11903)
-
-  > The first paper propose the idea of chain-of-thought
-
-## Useful Resources
-
-- [Chain-of-Thoughts Papers](https://github.com/Timothyxxx/Chain-of-ThoughtsPapers) - A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models".
-- [Reasoning using Language Models](https://github.com/atfortes/LM-Reasoning-Papers) - Collection of papers and resources on Reasoning using Language Models.

package/Awesome-LLM/paper_list/detection.md

@@ -1,11 +0,0 @@
-# Detection
-
-> Detect LLM-generated text from texts written by humans
-
-## Papers
-
-### 2023
-
-- (2023-01) **How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection** [paper](https://arxiv.org/abs/2301.07597) | [project](https://github.com/Hello-SimpleAI/chatgpt-comparison-detection)
-
-- (2023-03) **The Science of Detecting LLM-Generated Texts** [paper](https://arxiv.org/abs/2303.07205)

package/Awesome-LLM/paper_list/evaluation.md

@@ -1,64 +0,0 @@
-# LLM-Evaluation
-
-## Papers
-
-### 2022
-
-- (2022-09) **News Summarization and Evaluation in the Era of GPT-3** [paper](https://arxiv.org/abs/2209.12356)
-
-### 2023
-
-- (2023-01) **How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection** [paper](https://arxiv.org/abs/2301.07597) | [project](https://github.com/Hello-SimpleAI/chatgpt-comparison-detection)
-
-- (2023-01) **Is ChatGPT A Good Translator? A Preliminary Study** [paper](https://arxiv.org/abs/2301.08745v2) | [code](https://github.com/wxjiao/Is-ChatGPT-A-Good-Translator)
-
-  >:exclamation: They only randomly select 50 sentences for evaluation, since there is no available API.
-
-- (2023-01) **Benchmarking Large Language Models for News Summarization** [paper](https://arxiv.org/abs/2301.13848)
-
-- (2023-02) **Is ChatGPT a General-Purpose Natural Language Processing Task Solver?** [paper](https://arxiv.org/abs/2302.06476)
-
-  >:exclamation: No large dataset evaluation, no few-shot in-context learning evaluation, due to lack of API.
-
-- (2023-02) **ChatGPT: Jack of all trades, master of none** [paper](https://arxiv.org/abs/2302.10724)
-
-- (2023-02) **Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT** [paper](https://arxiv.org/abs/2302.10198)
-
-- (2023-02) **On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspective** [paper](https://arxiv.org/abs/2302.12095)
-
-- (2023-02) **Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarization** [paper](https://arxiv.org/abs/2302.08081)
-
-- (2023-02) **ChatGPT: potential, prospects, and limitations** [paper](https://doi.org/10.1631/FITEE.2300089)
-
-- (2023-03) **How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Tasks.** [paper](https://arxiv.org/abs/2303.00293)
-
-- (2023-03) **ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks** [paper](https://arxiv.org/abs/2303.15056)
-
-- (2023-03) **Consistency Analysis of ChatGPT** [paper](https://arxiv.org/abs/2303.06273)
-
-- (2023-03) **Could a Large Language Model be Conscious?** [paper](https://arxiv.org/abs/2303.07103)
-
-- (2023-03) **Susceptibility to Influence of Large Language Models** [paper](https://arxiv.org/abs/2303.06074)
-
-- (2023-03) **A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Models** [paper](https://arxiv.org/abs/2303.10420)
-- (2023-03) **Sparks of Artificial General Intelligence: Early experiments with GPT-4** [paper](https://arxiv.org/abs/2303.12712)
-
-- (2023-03) **ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks** [paper](https://arxiv.org/abs/2303.15056)
-- (2023-04) **Is ChatGPT a Highly Fluent Grammatical Error Correction System? A Comprehensive Evaluation** [paper](https://arxiv.org/abs/2304.01746)
-
-- (2023-03) **Is ChatGPT a Good NLG Evaluator? A Preliminary Study** [paper](https://arxiv.org/abs/2303.04048)
-
-- (2023-04) **Is ChatGPT a Good Sentiment Analyzer? A Preliminary Study** [paper](https://arxiv.org/abs/2304.04339)
-
-- (2023-04) **Emergent and Predictable Memorization in Large Language Models** [paper](https://arxiv.org/abs/2304.11158)
-
-- (2023-04) **Why Does ChatGPT Fall Short in Answering Questions Faithfully?** [paper](https://arxiv.org/abs/2304.10513)
-
-- (2023-04) **Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness** [paper](https://arxiv.org/abs/2304.11633)
- 
-- (2023-04) **Are Emergent Abilities of Large Language Models a Mirage?** [paper](https://arxiv.org/abs/2304.15004)
-
-- (2023-10) **Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators** [paper](https://arxiv.org/abs/2310.07289) | [code](https://github.com/ChanLiang/CONNER)
-
-## Useful Resources
-

package/Awesome-LLM/paper_list/in_context_learning.md

@@ -1,4 +0,0 @@
-# In-context Learning
-> Large language models (LLMs) demonstrate an in-context learning (ICL) ability, that is, learning from a few examples in the context.
-## Useful Resource
-- [ICL_PaperList](https://github.com/dqxiu/ICL_PaperList) - An active repository for ICL paper list.

package/Awesome-LLM/paper_list/instruction-tuning.md

@@ -1,35 +0,0 @@
-# Instruction-Tuning
-
-## Papers
-
-### 2021
-
-- (2021-04) **Cross-task generalization via natural language crowdsourcing instructions.** [paper](https://arxiv.org/abs/2104.08773)
-- (2021-04) **Adapting language models for zero-shot learning by meta-tuning on dataset and prompt collections** [paper](https://aclanthology.org/2021.findings-emnlp.244/)
-- (2021-04) **Crossfit: A few-shot learning challenge for cross-task general- ization in NLP** [paper](https://arxiv.org/abs/2104.08835)
-
-- (2021-09) **Finetuned language models are zero-shot learners** [paper](https://openreview.net/forum?id=gEZrGCozdqR) 
-
-  > FLAN
-
-- (2021-10) **Multitask prompted training enables zero-shot task generalization**  [paper](https://openreview.net/forum?id=9Vrb9D0WI4)
-
-- (2021-10) **MetaICL: Learning to learn in context**  [paper](https://arxiv.org/abs/2110.15943)
-
-### 2022
-
-- (2022-03) **Training language models to follow instructions with human feedback.**  [paper](https://arxiv.org/abs/2203.02155)
-
-- (2022-04) **Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks** [paper](https://arxiv.org/abs/2204.07705)
-
-- (20220-10) **Scaling Instruction-Finetuned Language Models**  [paper](https://arxiv.org/pdf/2210.11416.pdf)
-
-  > Flan-T5/PaLM
-
-### 2023 
-
-- (2023-04) **WizardLM: Empowering Large Language Models to Follow Complex Instructions** [paper](https://arxiv.org/abs/2304.12244)
-
-## Useful Resources
-
-- [Instruction-Tuning-Papers](https://github.com/SinclairCoder/Instruction-Tuning-Papers) - A trend starts from `Natrural-Instruction` (ACL 2022), `FLAN` (ICLR 2022) and `T0` (ICLR 2022).

package/Awesome-LLM/paper_list/prompt_learning.md

@@ -1,15 +0,0 @@
-# Prompt Learning
-
-## Papers
-
-### 2020
-
-- (2020-12) **Making Pre-trained Language Models Better Few-shot Learners**  [paper](https://arxiv.org/pdf/2012.15723.pdf)
-
-### 2021
-
-- (2021-07)  **Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing** [paper](https://arxiv.org/abs/2107.13586)
-
-  > A Systematic Survey
-
-## Useful Resources

package/Awesome-LLM/resources/DeepSpeed_light.svg

@@ -1,27 +0,0 @@
-<svg width="287" height="107" viewBox="0 0 287 107" fill="none" xmlns="http://www.w3.org/2000/svg">
-<g clip-path="url(#clip0)">
-<rect width="287" height="107" fill="white"/>
-<path d="M110.738 65.5H108.096V62.6963H108.031C106.807 64.8232 104.916 65.8867 102.359 65.8867C100.286 65.8867 98.6265 65.1509 97.3804 63.6792C96.145 62.1968 95.5273 60.1826 95.5273 57.6367C95.5273 54.9082 96.2148 52.7222 97.5898 51.0786C98.9648 49.4351 100.796 48.6133 103.084 48.6133C105.351 48.6133 107 49.5049 108.031 51.2881H108.096V41.0723H110.738V65.5ZM108.096 58.0396V55.6064C108.096 54.2744 107.655 53.1465 106.774 52.2227C105.894 51.2988 104.776 50.8369 103.423 50.8369C101.812 50.8369 100.544 51.4277 99.6201 52.6094C98.6963 53.791 98.2344 55.4238 98.2344 57.5078C98.2344 59.4092 98.6748 60.9131 99.5557 62.0195C100.447 63.1152 101.64 63.6631 103.133 63.6631C104.604 63.6631 105.797 63.1313 106.71 62.0679C107.634 61.0044 108.096 59.6616 108.096 58.0396ZM129.349 57.9106H117.699C117.742 59.7476 118.236 61.1655 119.182 62.1646C120.127 63.1636 121.427 63.6631 123.081 63.6631C124.939 63.6631 126.647 63.0508 128.205 61.8262V64.3076C126.755 65.3604 124.837 65.8867 122.453 65.8867C120.122 65.8867 118.29 65.1401 116.958 63.647C115.626 62.1431 114.96 60.0322 114.96 57.3145C114.96 54.7471 115.685 52.6577 117.135 51.0464C118.596 49.4243 120.406 48.6133 122.565 48.6133C124.725 48.6133 126.395 49.3115 127.577 50.708C128.758 52.1045 129.349 54.0435 129.349 56.5249V57.9106ZM126.642 55.6709C126.631 54.1455 126.261 52.9585 125.53 52.1099C124.811 51.2612 123.806 50.8369 122.517 50.8369C121.271 50.8369 120.213 51.2827 119.343 52.1743C118.473 53.0659 117.936 54.2314 117.731 55.6709H126.642ZM146.623 57.9106H134.973C135.016 59.7476 135.51 61.1655 136.455 62.1646C137.4 63.1636 138.7 63.6631 140.354 63.6631C142.213 63.6631 143.921 63.0508 145.479 61.8262V64.3076C144.028 65.3604 142.111 65.8867 139.726 65.8867C137.395 65.8867 135.563 65.1401 134.231 63.647C132.899 62.1431 132.233 60.0322 132.233 57.3145C132.233 54.7471 132.958 52.6577 134.409 51.0464C135.87 49.4243 137.68 48.6133 139.839 48.6133C141.998 48.6133 143.668 49.3115 144.85 50.708C146.032 52.1045 146.623 54.0435 146.623 56.5249V57.9106ZM143.916 55.6709C143.905 54.1455 143.534 52.9585 142.804 52.1099C142.084 51.2612 141.08 50.8369 139.791 50.8369C138.544 50.8369 137.486 51.2827 136.616 52.1743C135.746 53.0659 135.209 54.2314 135.005 55.6709H143.916ZM153.342 63.1152H153.277V73.0894H150.635V49H153.277V51.9004H153.342C154.642 49.709 156.543 48.6133 159.046 48.6133C161.173 48.6133 162.833 49.3545 164.025 50.8369C165.217 52.3086 165.813 54.2852 165.813 56.7666C165.813 59.5273 165.142 61.7402 163.799 63.4053C162.457 65.0596 160.62 65.8867 158.289 65.8867C156.151 65.8867 154.502 64.9629 153.342 63.1152ZM153.277 56.4604V58.7646C153.277 60.1289 153.718 61.2891 154.599 62.2451C155.49 63.1904 156.618 63.6631 157.982 63.6631C159.583 63.6631 160.834 63.0508 161.737 61.8262C162.65 60.6016 163.106 58.8989 163.106 56.7183C163.106 54.8813 162.682 53.4419 161.833 52.3999C160.985 51.3579 159.835 50.8369 158.385 50.8369C156.849 50.8369 155.614 51.374 154.679 52.4482C153.745 53.5117 153.277 54.8491 153.277 56.4604ZM169.036 64.9038V62.0679C170.476 63.1313 172.06 63.6631 173.79 63.6631C176.11 63.6631 177.27 62.8896 177.27 61.3428C177.27 60.9023 177.168 60.5317 176.964 60.231C176.771 59.9194 176.502 59.6455 176.158 59.4092C175.825 59.1729 175.428 58.9634 174.966 58.7808C174.515 58.5874 174.026 58.3887 173.5 58.1846C172.769 57.8945 172.125 57.6045 171.566 57.3145C171.018 57.0137 170.556 56.6807 170.18 56.3154C169.815 55.9395 169.536 55.5151 169.342 55.0425C169.16 54.5698 169.068 54.0166 169.068 53.3828C169.068 52.6094 169.246 51.9272 169.6 51.3364C169.955 50.7349 170.427 50.2354 171.018 49.8379C171.609 49.4297 172.28 49.1235 173.032 48.9194C173.795 48.7153 174.579 48.6133 175.385 48.6133C176.813 48.6133 178.092 48.8604 179.22 49.3545V52.0293C178.006 51.2344 176.609 50.8369 175.03 50.8369C174.536 50.8369 174.09 50.896 173.693 51.0142C173.295 51.1216 172.952 51.2773 172.662 51.4814C172.382 51.6855 172.162 51.9326 172.001 52.2227C171.851 52.502 171.775 52.8135 171.775 53.1572C171.775 53.5869 171.851 53.9468 172.001 54.2368C172.162 54.5269 172.393 54.7847 172.694 55.0103C172.995 55.2358 173.36 55.4399 173.79 55.6226C174.219 55.8052 174.708 56.0039 175.256 56.2188C175.986 56.498 176.642 56.7881 177.222 57.0889C177.802 57.3789 178.296 57.7119 178.704 58.0879C179.112 58.4531 179.424 58.8774 179.639 59.3608C179.864 59.8442 179.977 60.4189 179.977 61.085C179.977 61.9014 179.794 62.6104 179.429 63.2119C179.075 63.8135 178.597 64.313 177.995 64.7104C177.394 65.1079 176.701 65.4033 175.917 65.5967C175.132 65.79 174.311 65.8867 173.451 65.8867C171.754 65.8867 170.282 65.5591 169.036 64.9038ZM186.761 63.1152H186.696V73.0894H184.054V49H186.696V51.9004H186.761C188.061 49.709 189.962 48.6133 192.465 48.6133C194.592 48.6133 196.251 49.3545 197.444 50.8369C198.636 52.3086 199.232 54.2852 199.232 56.7666C199.232 59.5273 198.561 61.7402 197.218 63.4053C195.875 65.0596 194.039 65.8867 191.708 65.8867C189.57 65.8867 187.921 64.9629 186.761 63.1152ZM186.696 56.4604V58.7646C186.696 60.1289 187.137 61.2891 188.018 62.2451C188.909 63.1904 190.037 63.6631 191.401 63.6631C193.002 63.6631 194.253 63.0508 195.156 61.8262C196.069 60.6016 196.525 58.8989 196.525 56.7183C196.525 54.8813 196.101 53.4419 195.252 52.3999C194.404 51.3579 193.254 50.8369 191.804 50.8369C190.268 50.8369 189.033 51.374 188.098 52.4482C187.164 53.5117 186.696 54.8491 186.696 56.4604ZM216.715 57.9106H205.065C205.108 59.7476 205.603 61.1655 206.548 62.1646C207.493 63.1636 208.793 63.6631 210.447 63.6631C212.306 63.6631 214.014 63.0508 215.571 61.8262V64.3076C214.121 65.3604 212.204 65.8867 209.819 65.8867C207.488 65.8867 205.656 65.1401 204.324 63.647C202.992 62.1431 202.326 60.0322 202.326 57.3145C202.326 54.7471 203.051 52.6577 204.501 51.0464C205.962 49.4243 207.772 48.6133 209.932 48.6133C212.091 48.6133 213.761 49.3115 214.943 50.708C216.125 52.1045 216.715 54.0435 216.715 56.5249V57.9106ZM214.008 55.6709C213.998 54.1455 213.627 52.9585 212.896 52.1099C212.177 51.2612 211.172 50.8369 209.883 50.8369C208.637 50.8369 207.579 51.2827 206.709 52.1743C205.839 53.0659 205.302 54.2314 205.098 55.6709H214.008ZM233.989 57.9106H222.339C222.382 59.7476 222.876 61.1655 223.821 62.1646C224.767 63.1636 226.066 63.6631 227.721 63.6631C229.579 63.6631 231.287 63.0508 232.845 61.8262V64.3076C231.395 65.3604 229.477 65.8867 227.092 65.8867C224.761 65.8867 222.93 65.1401 221.598 63.647C220.266 62.1431 219.6 60.0322 219.6 57.3145C219.6 54.7471 220.325 52.6577 221.775 51.0464C223.236 49.4243 225.046 48.6133 227.205 48.6133C229.364 48.6133 231.035 49.3115 232.216 50.708C233.398 52.1045 233.989 54.0435 233.989 56.5249V57.9106ZM231.282 55.6709C231.271 54.1455 230.9 52.9585 230.17 52.1099C229.45 51.2612 228.446 50.8369 227.157 50.8369C225.911 50.8369 224.853 51.2827 223.982 52.1743C223.112 53.0659 222.575 54.2314 222.371 55.6709H231.282ZM252.084 65.5H249.441V62.6963H249.377C248.152 64.8232 246.262 65.8867 243.705 65.8867C241.632 65.8867 239.972 65.1509 238.726 63.6792C237.491 62.1968 236.873 60.1826 236.873 57.6367C236.873 54.9082 237.561 52.7222 238.936 51.0786C240.311 49.4351 242.142 48.6133 244.43 48.6133C246.697 48.6133 248.346 49.5049 249.377 51.2881H249.441V41.0723H252.084V65.5ZM249.441 58.0396V55.6064C249.441 54.2744 249.001 53.1465 248.12 52.2227C247.239 51.2988 246.122 50.8369 244.769 50.8369C243.157 50.8369 241.89 51.4277 240.966 52.6094C240.042 53.791 239.58 55.4238 239.58 57.5078C239.58 59.4092 240.021 60.9131 240.901 62.0195C241.793 63.1152 242.985 63.6631 244.479 63.6631C245.95 63.6631 247.143 63.1313 248.056 62.0679C248.979 61.0044 249.441 59.6616 249.441 58.0396Z" fill="black"/>
-<path d="M34.1305 67.6806C36.4372 65.3739 39.6428 64.8396 41.2905 66.4872C42.9381 68.1349 42.4039 71.3405 40.0971 73.6472C37.7904 75.954 23.9871 83.7906 23.9871 83.7906C23.9871 83.7906 31.8238 69.9873 34.1305 67.6806Z" fill="#FFC60F"/>
-<circle cx="40.0974" cy="37.2509" r="3.79717" transform="rotate(45 40.0974 37.2509)" fill="#F17F00"/>
-<circle cx="55.6108" cy="52.764" r="3.79717" transform="rotate(45 55.6108 52.764)" fill="#F17F00"/>
-<circle cx="78.881" cy="29.494" r="3.79717" transform="rotate(45 78.881 29.494)" fill="#F17F00"/>
-<circle cx="38.3074" cy="56.9408" r="3.79717" transform="rotate(45 38.3074 56.9408)" fill="#F17F00"/>
-<circle cx="70.5278" cy="67.681" r="3.79717" transform="rotate(45 70.5278 67.681)" fill="#F17F00"/>
-<circle cx="50.8379" cy="69.4711" r="3.79717" transform="rotate(45 50.8379 69.4711)" fill="#F17F00"/>
-<line x1="39.947" y1="37.4136" x2="78.8092" y2="29.4793" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="70.3643" y1="68.1263" x2="78.8823" y2="29.3333" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="40.4924" y1="36.7975" x2="38.4654" y2="57.0154" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="38.1289" y1="56.8053" x2="56.0291" y2="52.4134" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="56.148" y1="52.3093" x2="51.1777" y2="69.9078" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="50.7678" y1="69.1781" x2="70.8194" y2="67.3004" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="50.4041" y1="69.6991" x2="39.9762" y2="37.0126" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="70.6683" y1="67.6962" x2="38.0867" y2="57.6573" stroke="#F17F00" stroke-width="1.5"/>
-<line x1="55.3219" y1="52.5941" x2="78.8712" y2="29.3586" stroke="#F17F00" stroke-width="1.5"/>
-</g>
-<defs>
-<clipPath id="clip0">
-<rect width="287" height="107" fill="white"/>
-</clipPath>
-</defs>
-</svg>

package/awesome-ai-gateways/CONTRIBUTING.md

@@ -1,49 +0,0 @@
-# Contributing to awesome-ai-gateways
-
-Thanks for your interest in contributing!
-
-## How to Contribute
-
-1. **Fork the repository**
-2. **Add your tool/resource** in the appropriate section
-3. **Follow the format** (see below)
-4. **Submit a Pull Request**
-
-## Format Guidelines
-
-### Adding a Tool
-
-```markdown
-- [ToolName](https://github.com/user/repo) - Brief description. [[License]](link)
-  - Key feature 1
-  - Key feature 2
-```
-
-### Requirements for Inclusion
-
-- Must be related to AI gateways, LLM routing, or related infrastructure
-- Must be a real, working project (no dead repos)
-- Should have a brief description of what it does
-- Include relevant metrics when available (stars, forks, etc.)
-
-### Categories
-
-- **AI Gateways** - Unified API gateways
-- **Semantic Caching** - Caching layer tools
-- **Cost Tracking & Analytics** - Monitoring and cost tools
-- **Load Balancing & Routing** - Traffic distribution
-- **API Management & Rate Limiting** - Access control
-- **Observability & Logging** - Tracing and monitoring
-- **SDKs & Libraries** - Client libraries
-- **Guardrails & Security** - Content filtering, security
-
-## Quality Standards
-
-- Links should be permanent (no redirect chains)
-- Include stars/forks if available
-- Prefer open-source with clear licensing
-- Avoid duplicate entries
-
-## Thank You!
-
-Your contributions help the community discover the best AI infrastructure tools.

package/awesome-ai-gateways/LICENSE

@@ -1,3 +0,0 @@
-CC0 1.0 Universal
-
-To the extent possible under law, the author has waived all copyright and related or neighboring rights to this work.

package/awesome-ai-gateways/README.md

@@ -1,190 +0,0 @@
-# Awesome AI Gateways [![Awesome](https://awesome.re/badge-flat.svg)](https://awesome.re)
-
-> A curated list of tools, libraries, and resources for LLM routing, orchestration, and gateway infrastructure.
-
-Managing 100+ LLM APIs, handling rate limits, implementing fallbacks, and tracking token costs is a massive operational headache. This list curates the best open-source tools, managed services, and resources to help you build production-grade AI infrastructure.
-
-## Contents
-
-- [AI Gateways](#ai-gateways)
-- [Semantic Caching](#semantic-caching)
-- [Cost Tracking and Analytics](#cost-tracking-and-analytics)
-- [Load Balancing and Routing](#load-balancing-and-routing)
-- [API Management and Rate Limiting](#api-management-and-rate-limiting)
-- [Observability and Logging](#observability-and-logging)
-- [Agentic Orchestration](#agentic-orchestration)
-- [SDKs and Libraries](#sdks-and-libraries)
-- [Guardrails and Security](#guardrails-and-security)
-- [Tutorials and Case Studies](#tutorials-and-case-studies)
-- [Communities](#communities)
-
-## AI Gateways
-
-Unified API gateways that route requests across multiple LLM providers.
-
-### Open Source
-
-- [LiteLLM](https://github.com/BerriAI/litellm#readme) - Python SDK and proxy server calling 100+ LLMs in OpenAI format.
-- [Portkey Gateway](https://github.com/Portkey-AI/gateway#readme) - Blazing fast AI gateway with 250+ LLMs, 50+ guardrails.
-- [Bifrost](https://github.com/maximhq/bifrost#readme) - High-performance AI gateway in Go with adaptive load balancing.
-- [Ferro Labs AI Gateway](https://github.com/ferro-labs/ai-gateway#readme) - Go-native gateway for 29 providers with caching & guardrails.
-- [A3M Router](https://github.com/Das-rebel/adaptive-memory-multi-model-router) - Open-source LLM gateway with 100% routing accuracy, 47+ providers, zero ML, and Chinese provider support. MIT license.
-- [Envoy AI Gateway](https://github.com/envoyproxy/ai-gateway#readme) - Unified access to GenAI services built on Envoy Gateway.
-- [LLM Gateway](https://github.com/theopenco/llmgateway#readme) - Unified interface for running and managing LLMs with analytics.
-- [Inference Gateway](https://github.com/inference-gateway/inference-gateway#readme) - Cloud-native gateway unifying multiple LLM providers.
-- [OpenGateLLM](https://github.com/etalab-ia/OpenGateLLM#readme) - Open-source API gateway focused on self-hosted LLMs.
-- [Routerly](https://github.com/Inebrio/Routerly#readme) - Self-hosted LLM gateway with intelligent multi-policy routing.
-- [Plexus](https://github.com/mcowger/plexus#readme) - Unified API gateway with OAuth auth, quota tracking, and 15+ providers.
-- [OpenZiti LLM Gateway](https://github.com/openziti/llm-gateway#readme) - Zero-trust LLM gateway with semantic routing and E2E encryption.
-- [Kong](https://github.com/Kong/kong#readme) - Enterprise API gateway with LLM routing plugin.
-- [LocalAI](https://github.com/mudler/LocalAI#readme) - Self-hosted, drop-in replacement for OpenAI API.
-- [lm-proxy](https://github.com/Nayjest/lm-proxy#readme) - Lightweight OpenAI-compatible proxy for multi-provider inference.
-- [LLM API Proxy](https://github.com/rxliuli/llm-api-proxy#readme) - Edge runtime proxy supporting OpenAI, Anthropic, Gemini, and more.
-- [LLMProxy](https://github.com/aiyuekuang/LLMProxy#readme) - High-performance reverse proxy for LLM inference with SSE streaming.
-- [Zuul](https://github.com/Netflix/zuul#readme) - Netflix edge gateway.
-
-### Managed Services
-
-- [Vercel AI Gateway](https://sdk.vercel.ai/docs/ai-gateway#readme) - Single endpoint for hundreds of AI models.
-- [Cloudflare AI Gateway](https://developers.cloudflare.com/ai-gateway/#readme) - Unified interface for AI providers at the edge.
-- [OpenRouter](https://openrouter.ai/#readme) - Unified API for 500+ models from 60+ providers.
-- [Portkey Hosted](https://portkey.ai/#readme) - Managed AI gateway with 1600+ LLMs and enterprise features.
-- [Braintrust](https://www.braintrust.dev/#readme) - Unified API with encrypted caching and integrated evaluation.
-- [Inworld Router](https://www.inworlds.ai/#readme) - LLM plus TTS pipelining for high-interactivity use cases.
-- [Maxim AI](https://www.getmaxim.ai/#readme) - End-to-end platform for simulation, evaluation, and monitoring.
-
-## Semantic Caching
-
-Reduce costs 60-80% by caching semantically similar responses.
-
-- [RedisVL SemanticCache](https://redis.io/docs/latest/develop/ai/redisvl/0.7.0/user_guide/llmcache/#readme) - Semantic caching built on Redis vector search.
-- [GPT-Cache](https://github.com/ZhouDaoquan/GPT-Cache#readme) - Semantic cache for LLM responses.
-- [semantic-prompt-cache](https://github.com/renswickd/semantic-prompt-cache#readme) - RAG plus Semantic Cache system with FAISS.
-- [vCache](https://arxiv.org/abs/2502.03771#readme) - Verified semantic prompt caching with adaptive thresholds.
-- [VectorQ](https://arxiv.org/abs/2503.05530#readme) - Adaptive similarity thresholds for semantic caching.
-- [Qdrant](https://github.com/qdrant/qdrant#readme) - Vector similarity search engine.
-- [Pinecone](https://www.pinecone.io/#readme) - Managed vector database.
-- [Chroma](https://github.com/chroma-core/chroma#readme) - Vector database for AI apps.
-- [pgvector](https://github.com/pgvector/pgvector#readme) - Vector similarity in PostgreSQL.
-- [FAISS](https://github.com/facebookresearch/faiss#readme) - Facebook vector search library.
-
-## Cost Tracking and Analytics
-
-Monitor, attribute, and optimize LLM spend.
-
-- [Langfuse](https://github.com/langfuse/langfuse#readme) - Open-source LLM engineering platform.
-- [Helicone](https://github.com/Helicone/helicone#readme) - Open-source LLM observability platform.
-- [Arize Phoenix](https://github.com/Arize-ai/phoenix#readme) - ML and LLM observability platform.
-- [Opik](https://github.com/comet-ml/opik#readme) - LLM development platform by Comet.
-- [tokenmeter](https://github.com/jugaad-lab/tokenmeter#readme) - Track AI API usage locally.
-- [tokentap](https://github.com/jmuncor/tokentap#readme) - Terminal dashboard for LLM token tracking.
-- [tokenator](https://github.com/ujjwalm29/tokenator#readme) - Monitor LLM token usage.
-- [LLM Cost Guardian](https://github.com/ogulcanaydogan/LLM-Cost-Guardian#readme) - Multi-provider cost tracking in Go.
-- [tokenx](https://github.com/dvlshah/tokenx#readme) - Python decorators for cost and latency monitoring.
-- [llm-performance-tracker](https://github.com/tinybirdco/llm-performance-tracker#readme) - Multi-tenant LLM analytics dashboard.
-- [Weave](https://weave.wandb.ai/#readme) - LLM observability from Weights and Biases.
-- [Datadog LLM Observability](https://www.datadoghq.com/product/llm-observability/#readme) - Enterprise monitoring with LLM metrics.
-- [PostHog](https://posthog.com/#readme) - Product analytics with LLM event tracking.
-- [Confident AI](https://www.confident-ai.com/#readme) - Evaluation-first observability platform.
-- [Maxim AI](https://www.getmaxim.ai/#readme) - End-to-end platform for simulation, evaluation, and monitoring.
-
-## Load Balancing and Routing
-
-Distribute traffic, implement failovers, and optimize costs.
-
-- [LiteLLM Router](https://docs.litellm.ai/docs/proxy/routing#readme) - Retry/fallback logic and least-busy routing.
-- [Portkey](https://portkey.ai/docs/routing-strategies#readme) - Conditional routing and percentage-based distribution.
-- [Bifrost Load Balancing](https://www.getmaxim.ai/bifrostdocs#readme) - Adaptive load balancer with cluster mode.
-- [Ferro Labs Router](https://github.com/ferro-labs/ai-gateway#readme) - Multi-provider routing with 29 providers.
-- [Routerly Policies](https://www.routerly.ai/#readme) - 9 configurable policies including LLM-native routing.
-- [Lovable: 1.8B tokens per minute load balancing](https://www.adwaitx.com/llm-provider-load-balancing-agent-workflows/#readme) - PID-controlled dynamic load balancing.
-
-## API Management and Rate Limiting
-
-Control access, prevent abuse, and enforce quotas.
-
-- [RateLimit4j](https://github.com/vladimir-bukhtoyarov/rate-limit#readme) - Java rate limiting library.
-- [Guava RateLimiter](https://github.com/google/guava#readme) - Google token bucket implementation.
-
-## Observability and Logging
-
-Full visibility into LLM behavior, performance, and costs.
-
-- [OpenTelemetry](https://opentelemetry.io/#readme) - Vendor-neutral observability framework.
-- [Traceloop OpenLLMetry](https://github.com/traceloop/openllmetry#readme) - OpenTelemetry for LLMs.
-- [Grafana](https://github.com/grafana/grafana#readme) - Metrics visualization.
-- [Loki](https://github.com/grafana/loki#readme) - Log aggregation for LLM logs.
-- [LiteLLM Logging](https://docs.litellm.ai/docs/production/logging#readme) - Logging to object storage.
-- [LiteLLM Admin UI](https://docs.litellm.ai/docs/production/litellm_dashboard#readme) - Built-in spend and usage dashboards.
-- [LiteLLM Grafana Dashboard](https://github.com/BerriAI/litellm/tree/main/litellm-main#readme) - Prometheus metrics visualization.
-- [AgentOps](https://www.agentops.ai/#readme) - Observability for agentic loops with tool usage tracking.
-
-## Agentic Orchestration
-
-Build and manage autonomous agents, long-running tasks, and multi-agent coordination.
-
-- [LangGraph](https://github.com/langchain-ai/langgraph#readme) - Low-level orchestration framework for building stateful, multi-agent applications.
-- [Agency Swarm](https://github.com/vrsen/agency-swarm#readme) - Multi-agent framework building collaborative networks of AI agents.
-- [CrewAI](https://github.com/crewAIInc/crewAI#readme) - Multi-agent framework with LLM routing.
-- [AutoGen](https://github.com/microsoft/autogen#readme) - Microsoft multi-agent framework.
-- [UiPath Maestro](https://www.uipath.com/#readme) - Enterprise orchestrator blending LLM agents with RPA and human-in-the-loop.
-
-## SDKs and Libraries
-
-Multi-provider abstractions and LLM client libraries.
-
-- [OpenAI Python SDK](https://github.com/openai/openai-python#readme) - Official OpenAI client.
-- [Anthropic Python SDK](https://github.com/anthropics/anthropic-sdk-python#readme) - Official Claude client.
-- [Vercel AI SDK](https://github.com/vercel/ai#readme) - AI SDK for Next.js and Svelte.
-- [LiteLLM Python SDK](https://docs.litellm.ai/docs/python-sdk#readme) - Unified interface for 100+ providers.
-- [Portkey Python SDK](https://docs.portkey.ai/docs/get-started/python-sdk#readme) - Multi-provider with tracing.
-- [LangChain](https://github.com/langchain-ai/langchain#readme) - LLM orchestration framework.
-- [LlamaIndex](https://github.com/run-llama/llama_index#readme) - RAG framework with gateway integrations.
-- [tiktoken](https://github.com/openai/tiktoken#readme) - Fast tokenization by OpenAI.
-- [tokenizers](https://github.com/huggingface/tokenizers#readme) - Hugging Face tokenizers.
-- [httpx](https://github.com/encode/httpx#readme) - Async HTTP client.
-- [Ferro Labs Go SDK](https://github.com/ferro-labs/ai-gateway#readme) - Go SDK for Ferro Labs gateway.
-
-## Guardrails and Security
-
-Content filtering, PII redaction, and prompt injection protection.
-
-- [Portkey Guardrails](https://docs.portkey.ai/docs/guardrails#readme) - Input and output filtering.
-- [LiteLLM Guardrails](https://docs.litellm.ai/docs/production/guardrails#readme) - Pre and post call hooks.
-- [Ferro Labs Guardrails](https://github.com/ferro-labs/ai-gateway#readme) - Word/phrase filtering and token limits.
-- [PromptGuard](https://github.com/protectai/promptguard#readme) - Prompt injection detection.
-- [NeMo Guardrails](https://github.com/NVIDIA/NeMo-Guardrails#readme) - NVIDIA dialogue guardrails.
-- [LLM Guard](https://github.com/burkelaine/llm-guard#readme) - Security toolkit for LLM applications.
-- [SlashLLM](https://slashllm.com/#readme) - Enterprise security platform.
-- [Azure AI Content Safety](https://azure.microsoft.com/en-us/products/ai-services/content-safety/#readme) - Microsoft content moderation.
-- [AWS AI Services](https://aws.amazon.com/machine-learning/ai-services/#readme) - Amazon content moderation.
-- [DeepEval](https://github.com/confident-ai/deepeval#readme) - Open-source testing framework for LLM outputs.
-- [OpenZiti Security](https://github.com/openziti/llm-gateway#readme) - Zero-trust access with E2E encryption.
-
-## Tutorials and Case Studies
-
-- [LiteLLM Quick Start](https://docs.litellm.ai/docs/#readme) - Official LiteLLM documentation.
-- [Bifrost Documentation](https://getmaxim.ai/bifrostdocs#readme) - Bifrost setup guide.
-- [Portkey Quick Start](https://docs.portkey.ai/docs/get-started#readme) - Portkey getting started guide.
-- [Building Multi-Provider LLM Infrastructure](https://medium.com/@ritukampani/future-proof-your-ai-building-a-gateway-for-multiple-llm-providers-b746f80cc169#readme) - Architecture guide.
-- [LLM Orchestration with Bifrost](https://dev.to/debmckinney/llm-orchestration-with-bifrost-routing-fallbacks-and-load-balancing-in-one-layer-40p3#readme) - Implementation guide.
-- [Failover Routing Strategies](https://portkey.ai/blog/failover-routing-strategies-for-llms-in-production#readme) - Production patterns.
-- [Semantic Caching Guide](https://scalemind.ai/blog/semantic-caching-llm-guide#readme) - Implementation best practices.
-- [Cost-Aware Routing Patterns](https://www.mindstudio.ai/blog/best-ai-model-routers-multi-provider-llm-cost/#readme) - Routing strategies.
-- [OpenRouter Multi-Provider Routing](https://dev.to/kirponik/mastering-multi-provider-routing-with-openrouter-1ce3#readme) - OpenRouter guide.
-- [Rasa Multi-LLM Routing](https://rasa.com/docs/production/llm-routing/#readme) - Rasa routing documentation.
-- [Cortex](https://arxiv.org/html/2509.17360v2#readme) - Semantic-aware knowledge caching for LLM agents.
-- [Ferro Labs Getting Started](https://github.com/ferro-labs/ai-gateway#readme) - Go-native gateway setup.
-- [Routerly Documentation](https://www.routerly.ai/#readme) - Intelligent routing guide.
-
-## Communities
-
-- [/r/LLMOps](https://reddit.com/r/LLMOps#readme) - Reddit community for LLM operations.
-- [LangChain Discord](https://discord.gg/langchain#readme) - Framework community.
-- [LiteLLM Discord](https://discord.gg/tdNkNArv#readme) - Gateway community.
-- [Hugging Face Community](https://discuss.huggingface.co/#readme) - Model and deployment discussions.
-
-## Related Awesome Lists
-
-- [rothgar/awesome-tuis](https://github.com/rothgar/awesome-tuis) - 18K+ stars, comprehensive TUI list.
-- [msmps/awesome-opentui](https://github.com/msmps/awesome-opentui) - Curated open TUI resources.

package/awesome-selfhosted/.github/ISSUE_TEMPLATE/config.yml

@@ -1,5 +0,0 @@
-blank_issues_enabled: false
-contact_links:
-  - name: "Awesome Selfhosted Data"
-    url: "https://github.com/awesome-selfhosted/awesome-selfhosted-data/issues"
-    about: "Please submit your issues or suggestions to the awesome-selfhosted-data repository instead."

package/awesome-selfhosted/.github/PULL_REQUEST_TEMPLATE.md

@@ -1 +0,0 @@
-Please do not submit pull requests in this repository. Use https://github.com/awesome-selfhosted/awesome-selfhosted-data instead.