@tokcalc/mcp-server 0.1.2 → 0.1.4

package/tool-results/bash_1789888195219_4a86a5c91411.txt

@@ -1,200 +0,0 @@
-|[Qwen/Qwen2.5-VL-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct)|Qwen 2.5-VL|[72B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-72B-Instruct)|[80](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[8192](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[64](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[2025-01-27](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-72B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|
-|[Qwen/Qwen2.5-MoE-A2.7B](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B)|Other|[n/a](https://huggingface.co/api/models/Qwen/Qwen2.5-MoE-A2.7B)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|n/a|[card](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B) · [config](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B/raw/main/config.json)|
-|[Qwen/Qwen2.5-Coder-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct)|Qwen 2.5 Coder|[7B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-7B-Instruct)|[28](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[3584](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[28](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[2024-09-17](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-7B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|
-|[Qwen/Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct)|Qwen 2.5 Coder|[14B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-14B-Instruct)|[48](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[2024-11-06](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-14B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|
-|[Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)|Qwen 2.5 Coder|[32B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-32B-Instruct)|[64](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[2024-11-06](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-32B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|
-|[deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3)|[61](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[2024-12-25](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3)|[card](https://huggingface.co/deepseek-ai/DeepSeek-V3) · [config](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|
-|[deepseek-ai/DeepSeek-V3-0324](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3-0324)|[61](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[2025-03-24](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3-0324)|[card](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324) · [config](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|
-|[deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1)|[61](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[2025-01-20](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1)|[card](https://huggingface.co/deepseek-ai/DeepSeek-R1) · [config](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|
-|[deepseek-ai/DeepSeek-R1-0528](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1-0528)|[61](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[2025-05-28](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1-0528)|[card](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528) · [config](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|
-|[deepseek-ai/DeepSeek-Coder-V2-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct)|DeepSeek Coder V2|[236B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Instruct)|[60](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[5120](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|n/a|[102400](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[2024-06-14](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Instruct)|[card](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct) · [config](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|
-|istralai/Mistral-Large-Instruct-2411](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411)|Mistral|[122.6B](https://huggingface.co/api/models/mistralai/Mistral-Large-Instruct-2411)|[88](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[12288](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[96](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json) / [8](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[128](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[131072](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[2024-11-14](https://huggingface.co/api/models/mistralai/Mistral-Large-Instruct-2411)|[card](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411) · [config](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|
-|istralai/Codestral-22B-v0.1](https://huggingface.co/mistralai/Codestral-22B-v0.1)|Mistral|[22.2B](https://huggingface.co/api/models/mistralai/Codestral-22B-v0.1)|[56](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[6144](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[48](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json) / [8](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|n/a|[32768](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[2024-05-29](https://huggingface.co/api/models/mistralai/Codestral-22B-v0.1)|[card](https://huggingface.co/mistralai/Codestral-22B-v0.1) · [config](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|
-|istralai/Ministral-3B-Instruct-2410](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410)|Mistral|[3B](https://huggingface.co/api/models/mistralai/Ministral-3B-Instruct-2410)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2024-10; repo 401](https://huggingface.co/api/models/mistralai/Ministral-3B-Instruct-2410)|[card](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410) · [config](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410/raw/main/config.json)|
-|istralai/Ministral-8B-Instruct-2410](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410)|Mistral|[8.0B](https://huggingface.co/api/models/mistralai/Ministral-8B-Instruct-2410)|[36](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[4096](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[32](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json) / [8](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[128](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[131072](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[2024-10-15](https://huggingface.co/api/models/mistralai/Ministral-8B-Instruct-2410)|[card](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410) · [config](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|
-|istralai/Pixtral-12B-2409](https://huggingface.co/mistralai/Pixtral-12B-2409)|Pixtral|[12B](https://huggingface.co/api/models/mistralai/Pixtral-12B-2409)|n/a|n/a|n/a / n/a|n/a|n/a|[128K advertised](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|[2024-09](https://huggingface.co/api/models/mistralai/Pixtral-12B-2409)|[card](https://huggingface.co/mistralai/Pixtral-12B-2409) · [config](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|
-|[google/gemma-3-1b-it](https://huggingface.co/google/gemma-3-1b-it)|Gemma 3|[1B](https://huggingface.co/api/models/google/gemma-3-1b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[32K](https://huggingface.co/google/gemma-3-1b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-1b-it)|[card](https://huggingface.co/google/gemma-3-1b-it) · [config](https://huggingface.co/google/gemma-3-1b-it/raw/main/config.json)|
-|[google/gemma-3-4b-it](https://huggingface.co/google/gemma-3-4b-it)|Gemma 3|[4B](https://huggingface.co/api/models/google/gemma-3-4b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-4b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-4b-it)|[card](https://huggingface.co/google/gemma-3-4b-it) · [config](https://huggingface.co/google/gemma-3-4b-it/raw/main/config.json)|
-|[google/gemma-3-12b-it](https://huggingface.co/google/gemma-3-12b-it)|Gemma 3|[12B](https://huggingface.co/api/models/google/gemma-3-12b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-12b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-12b-it)|[card](https://huggingface.co/google/gemma-3-12b-it) · [config](https://huggingface.co/google/gemma-3-12b-it/raw/main/config.json)|
-|[google/gemma-3-27b-it](https://huggingface.co/google/gemma-3-27b-it)|Gemma 3|[27B](https://huggingface.co/api/models/google/gemma-3-27b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-27b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-27b-it)|[card](https://huggingface.co/google/gemma-3-27b-it) · [config](https://huggingface.co/google/gemma-3-27b-it/raw/main/config.json)|
-|[google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it)|Gemma 2|[2B](https://huggingface.co/api/models/google/gemma-2-2b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-2b-it/raw/main/config.json)|[2024-07](https://huggingface.co/api/models/google/gemma-2-2b-it)|[card](https://huggingface.co/google/gemma-2-2b-it) · [config](https://huggingface.co/google/gemma-2-2b-it/raw/main/config.json)|
-|[google/gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it)|Gemma 2|[9B](https://huggingface.co/api/models/google/gemma-2-9b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-9b-it/raw/main/config.json)|[2024-06](https://huggingface.co/api/models/google/gemma-2-9b-it)|[card](https://huggingface.co/google/gemma-2-9b-it) · [config](https://huggingface.co/google/gemma-2-9b-it/raw/main/config.json)|
-|[google/gemma-2-27b-it](https://huggingface.co/google/gemma-2-27b-it)|Gemma 2|[27B](https://huggingface.co/api/models/google/gemma-2-27b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-27b-it/raw/main/config.json)|[2024-06](https://huggingface.co/api/models/google/gemma-2-27b-it)|[card](https://huggingface.co/google/gemma-2-27b-it) · [config](https://huggingface.co/google/gemma-2-27b-it/raw/main/config.json)|
-|icrosoft/phi-4](https://huggingface.co/microsoft/phi-4)|Phi|[14.7B](https://huggingface.co/api/models/microsoft/phi-4)|[40](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[5120](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[40](https://huggingface.co/microsoft/phi-4/raw/main/config.json) / [10](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|n/a|[100352](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[16384](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[2024-12-11](https://huggingface.co/api/models/microsoft/phi-4)|[card](https://huggingface.co/microsoft/phi-4) · [config](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|
-|icrosoft/Phi-4-mini-instruct](https://huggingface.co/microsoft/Phi-4-mini-instruct)|Phi|[3.8B](https://huggingface.co/api/models/microsoft/Phi-4-mini-instruct)|[32](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[3072](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[24](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json) / [8](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|n/a|[200064](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[2025-02-19](https://huggingface.co/api/models/microsoft/Phi-4-mini-instruct)|[card](https://huggingface.co/microsoft/Phi-4-mini-instruct) · [config](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|
-|icrosoft/Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct)|Phi|[3.8B](https://huggingface.co/api/models/microsoft/Phi-3.5-mini-instruct)|[32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[3072](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json) / [32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|n/a|[32064](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[2024-08-16](https://huggingface.co/api/models/microsoft/Phi-3.5-mini-instruct)|[card](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) · [config](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|
-|icrosoft/Phi-3.5-MoE-instruct](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct)|Phi|[41.9B](https://huggingface.co/api/models/microsoft/Phi-3.5-MoE-instruct)|[32](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[4096](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[32](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json) / [8](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|n/a|[32064](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[2024-08-17](https://huggingface.co/api/models/microsoft/Phi-3.5-MoE-instruct)|[card](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct) · [config](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|
-|[WizardLM/WizardLM-2-8x22B](https://huggingface.co/WizardLM/WizardLM-2-8x22B)|WizardLM|[141B](https://huggingface.co/api/models/WizardLM/WizardLM-2-8x22B)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2024-04](https://huggingface.co/api/models/WizardLM/WizardLM-2-8x22B)|[card](https://huggingface.co/WizardLM/WizardLM-2-8x22B) · [config](https://huggingface.co/WizardLM/WizardLM-2-8x22B/raw/main/config.json)|
-|icrosoft/Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b)|Orca|[n/a](https://huggingface.co/api/models/microsoft/Orca-2-13b)|[40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[5120](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json) / [40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|n/a|[32003](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[4096](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[2023-11-14](https://huggingface.co/api/models/microsoft/Orca-2-13b)|[card](https://huggingface.co/microsoft/Orca-2-13b) · [config](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|
-|icrosoft/BitNet-b1.58-2B-4T](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T)|BitNet|[850M](https://huggingface.co/api/models/microsoft/BitNet-b1.58-2B-4T)|[30](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[2560](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[20](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json) / [5](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|n/a|[128256](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[4096](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[2025-04-15](https://huggingface.co/api/models/microsoft/BitNet-b1.58-2B-4T)|[card](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T) · [config](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|
-|[HuggingFaceTB/SmolLM2-135M](https://huggingface.co/HuggingFaceTB/SmolLM2-135M)|SmolLM2|[135M](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-135M)|[30](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[576](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[9](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json) / [3](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[2024-10-31](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-135M)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-135M) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|
-|[HuggingFaceTB/SmolLM2-360M](https://huggingface.co/HuggingFaceTB/SmolLM2-360M)|SmolLM2|[362M](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-360M)|[32](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[960](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[15](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json) / [5](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[2024-10-31](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-360M)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-360M) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|
-|[HuggingFaceTB/SmolLM2-1.7B](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B)|SmolLM2|[1.7B](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-1.7B)|[24](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[2048](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[32](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json) / [32](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[2024-10-30](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-1.7B)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|
-|[TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|TinyLlama|[1.1B](https://huggingface.co/api/models/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|[22](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2048](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[32](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json) / [4](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|n/a|[32000](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2048](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2023-12-30](https://huggingface.co/api/models/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|[card](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) · [config](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|
-|[allenai/OLMo-2-1124-7B-Instruct](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct)|OLMo|[7.3B](https://huggingface.co/api/models/allenai/OLMo-2-1124-7B-Instruct)|[32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[4096](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json) / [32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|n/a|[100352](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[4096](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[2024-12-18](https://huggingface.co/api/models/allenai/OLMo-2-1124-7B-Instruct)|[card](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct) · [config](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|
-|[tiiuae/Falcon3-7B-Instruct](https://huggingface.co/tiiuae/Falcon3-7B-Instruct)|Falcon 3|[7.5B](https://huggingface.co/api/models/tiiuae/Falcon3-7B-Instruct)|[28](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[3072](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[12](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[256](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[131072](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[2024-11-29](https://huggingface.co/api/models/tiiuae/Falcon3-7B-Instruct)|[card](https://huggingface.co/tiiuae/Falcon3-7B-Instruct) · [config](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|
-|[01-ai/Yi-1.5-9B-Chat](https://huggingface.co/01-ai/Yi-1.5-9B-Chat)|Yi 1.5|[8.8B](https://huggingface.co/api/models/01-ai/Yi-1.5-9B-Chat)|[48](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[4096](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[32](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json) / [4](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|n/a|[64000](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[4096](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[2024-05-10](https://huggingface.co/api/models/01-ai/Yi-1.5-9B-Chat)|[card](https://huggingface.co/01-ai/Yi-1.5-9B-Chat) · [config](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|
-|[internlm/internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)|InternLM 2.5|[7.7B](https://huggingface.co/api/models/internlm/internlm2_5-7b-chat)|[32](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[4096](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[32](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json) / [8](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|n/a|[92544](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[32768](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[2024-06-27](https://huggingface.co/api/models/internlm/internlm2_5-7b-chat)|[card](https://huggingface.co/internlm/internlm2_5-7b-chat) · [config](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|
-|[deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|DeepSeek Coder V2|[16B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|[27](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[2048](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[16](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json) / [16](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|n/a|[102400](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[2024-06-14](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|[card](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct) · [config](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|
-|[codellama/CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf)|CodeLlama|[6.7B](https://huggingface.co/api/models/codellama/CodeLlama-7b-hf)|[32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[4096](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json) / [32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|n/a|[32016](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[16384](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[2023-08-24](https://huggingface.co/api/models/codellama/CodeLlama-7b-hf)|[card](https://huggingface.co/codellama/CodeLlama-7b-hf) · [config](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|
-|[codellama/CodeLlama-34b-Instruct-hf](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf)|CodeLlama|[33.7B](https://huggingface.co/api/models/codellama/CodeLlama-34b-Instruct-hf)|[48](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[8192](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[64](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json) / [8](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|n/a|[32000](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[16384](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[2023-08-24](https://huggingface.co/api/models/codellama/CodeLlama-34b-Instruct-hf)|[card](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf) · [config](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|
-|[Qwen/QwQ-32B](https://huggingface.co/Qwen/QwQ-32B)|QwQ|[32.8B](https://huggingface.co/api/models/Qwen/QwQ-32B)|[64](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[5120](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[40](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json) / [8](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[2025-03-05](https://huggingface.co/api/models/Qwen/QwQ-32B)|[card](https://huggingface.co/Qwen/QwQ-32B) · [config](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|
-
-## Embeddings
-
-|Model|Family|Params|Layers|Hidden|Heads|Vocab|Max sequence|Source|
-|---|---|---:|---:|---:|---:|---:|---:|---|
-|[BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3)|Embeddings|[n/a](https://huggingface.co/api/models/BAAI/bge-m3)|[24](https://huggingface.co/BAAI/bge-m3/raw/main/config.json)|[1024](https://huggingface.co/BAAI/bge-m3/raw/main/config.json)|[16](https://huggingface.co/BAAI/bge-m3/raw/main/config.json)|[250002](https://huggingface.co/BAAI/bge-m3/raw/main/config.json)|[8194](https://huggingface.co/BAAI/bge-m3/raw/main/config.json)|[card](https://huggingface.co/BAAI/bge-m3) · [config](https://huggingface.co/BAAI/bge-m3/raw/main/config.json)|
-|[intfloat/e5-large-v2](https://huggingface.co/intfloat/e5-large-v2)|Embeddings|[335M](https://huggingface.co/api/models/intfloat/e5-large-v2)|[24](https://huggingface.co/intfloat/e5-large-v2/raw/main/config.json)|[1024](https://huggingface.co/intfloat/e5-large-v2/raw/main/config.json)|[16](https://huggingface.co/intfloat/e5-large-v2/raw/main/config.json)|[30522](https://huggingface.co/intfloat/e5-large-v2/raw/main/config.json)|[512](https://huggingface.co/intfloat/e5-large-v2/raw/main/config.json)|[card](https://huggingface.co/intfloat/e5-large-v2) · [config](https://huggingface.co/intfloat/e5-large-v2/raw/main/config.json)|
-|[thenlper/gte-large](https://huggingface.co/thenlper/gte-large)|Embeddings|[335M](https://huggingface.co/api/models/thenlper/gte-large)|[24](https://huggingface.co/thenlper/gte-large/raw/main/config.json)|[1024](https://huggingface.co/thenlper/gte-large/raw/main/config.json)|[16](https://huggingface.co/thenlper/gte-large/raw/main/config.json)|[30522](https://huggingface.co/thenlper/gte-large/raw/main/config.json)|[512](https://huggingface.co/thenlper/gte-large/raw/main/config.json)|[card](https://huggingface.co/thenlper/gte-large) · [config](https://huggingface.co/thenlper/gte-large/raw/main/config.json)|
-|[nomic-ai/nomic-embed-text-v1.5](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5)|Embeddings|[137M](https://huggingface.co/api/models/nomic-ai/nomic-embed-text-v1.5)|[12](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5/raw/main/config.json)|[768](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5/raw/main/config.json)|[12](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5/raw/main/config.json)|[30528](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5/raw/main/config.json)|[2048](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5/raw/main/config.json)|[card](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5) · [config](https://huggingface.co/nomic-ai/nomic-embed-text-v1.5/raw/main/config.json)|
-|[jinaai/jina-embeddings-v3](https://huggingface.co/jinaai/jina-embeddings-v3)|Embeddings|[572M](https://huggingface.co/api/models/jinaai/jina-embeddings-v3)|[24](https://huggingface.co/jinaai/jina-embeddings-v3/raw/main/config.json)|[1024](https://huggingface.co/jinaai/jina-embeddings-v3/raw/main/config.json)|[16](https://huggingface.co/jinaai/jina-embeddings-v3/raw/main/config.json)|[250002](https://huggingface.co/jinaai/jina-embeddings-v3/raw/main/config.json)|[8194](https://huggingface.co/jinaai/jina-embeddings-v3/raw/main/config.json)|[card](https://huggingface.co/jinaai/jina-embeddings-v3) · [config](https://huggingface.co/jinaai/jina-embeddings-v3/raw/main/config.json)|
-
-## Vision-language
-
-|Model|Family|Total params|Architecture summary|Vocab|Context|Source|
-|---|---|---:|---|---:|---:|---|
-|istralai/Pixtral-12B-2409](https://huggingface.co/mistralai/Pixtral-12B-2409)|Pixtral|[12B](https://huggingface.co/api/models/mistralai/Pixtral-12B-2409)|[n/a / n/a / n/a](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|n/a|n/a|[card](https://huggingface.co/mistralai/Pixtral-12B-2409) · [config](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|
-|[Qwen/Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct)|Qwen 2.5-VL|[7B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-7B-Instruct)|[28 / 3584 / 28 q](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|
-|[Qwen/Qwen2.5-VL-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct)|Qwen 2.5-VL|[32B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-32B-Instruct)|[64 / 5120 / 40 q](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|
-|[Qwen/Qwen2.5-VL-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct)|Qwen 2.5-VL|[72B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-72B-Instruct)|[80 / 8192 / 64 q](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|
-|[OpenGVLab/InternVL2-8B](https://huggingface.co/OpenGVLab/InternVL2-8B)|Vision-language|[8B combined](https://huggingface.co/api/models/OpenGVLab/InternVL2-8B)|[32 LLM / 24 vision / 4096 LLM / 1024 vision / 32 LLM / 16 vision](https://huggingface.co/OpenGVLab/InternVL2-8B/raw/main/config.json)|n/a|[92553](https://huggingface.co/OpenGVLab/InternVL2-8B/raw/main/config.json)|[card](https://huggingface.co/OpenGVLab/InternVL2-8B) · [config](https://huggingface.co/OpenGVLab/InternVL2-8B/raw/main/config.json)|
-|[THUDM/cogvlm2-llama3-chat-19B](https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B)|Vision-language|[19B combined](https://huggingface.co/api/models/THUDM/cogvlm2-llama3-chat-19B)|[32 / 4096 / 32 / n/a](https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B/raw/main/config.json)|n/a|[128256](https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B/raw/main/config.json)|[card](https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B) · [config](https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B/raw/main/config.json)|
-
-## Audio ASR
-
-|Model|Params|Layers/hidden|Vocab|Source|
-|---|---:|---|---:|---|
-|[openai/whisper-large-v3-turbo](https://huggingface.co/openai/whisper-large-v3-turbo)|[809M](https://huggingface.co/api/models/openai/whisper-large-v3-turbo)|[n/a / 1280](https://huggingface.co/openai/whisper-large-v3-turbo/raw/main/config.json)|[51866](https://huggingface.co/openai/whisper-large-v3-turbo/raw/main/config.json)|[card](https://huggingface.co/openai/whisper-large-v3-turbo)|
-|[nvidia/parakeet-tdt-0.6b-v2](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2)|[0.6B](https://huggingface.co/api/models/nvidia/parakeet-tdt-0.6b-v2)|[n/a / n/a](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2/raw/main/config.json)|n/a|[card](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2)|
-|[distil-whisper/distil-large-v3](https://huggingface.co/distil-whisper/distil-large-v3)|[756M](https://huggingface.co/api/models/distil-whisper/distil-large-v3)|[32 / 1280](https://huggingface.co/distil-whisper/distil-large-v3/raw/main/config.json)|[51866](https://huggingface.co/distil-whisper/distil-large-v3/raw/main/config.json)|[card](https://huggingface.co/distil-whisper/distil-large-v3)|
-
-ASR throughput should be modeled as audio-seconds processed per wall-clock second (real-time factor), not text token/sec. Keep audio duration, sample rate, chunking, beam/decoder settings, and WER separate from decoder LLM token metrics. Parakeet’s card reports WER but no universal token/sec.
-
-## Release/status exceptions and verified facts
-
-- **Llama 4 Scout/Maverick:** Meta describes both as MoE with 17B active; HF release material reports approximately 109B total for Scout and 400B for Maverick. Behemoth is announced at nearly 2T total and 288B active, but the official HF path was inaccessible/weights unavailable in this check. [Meta announcement](https://ai.meta.com/blog/llama-4-multimodal-intelligence) · [HF release](https://huggingface.co/blog/llama4-release)
-- **DeepSeek:** V3 and R1 are 671B total / 37B active per the HF card; V3 card says 128K context, while its config exposes 163840—store both fields and show a conflict warning. Coder V2 full is 236B / 21B active and Lite is 16B / 2.4B active. [V3](https://huggingface.co/deepseek-ai/DeepSeek-V3) · [R1](https://huggingface.co/deepseek-ai/DeepSeek-R1) · [Coder V2](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct)
-- **DeepSeek V3.5 / R2:** No verified official HF model card or primary release page under those names was found in the checked universe as of the cutoff. Keep them as `status=pending/unverified`, not as inference rows.
-- **Qwen MoE naming:** The public documented model is **Qwen1.5-MoE-A2.7B**, 14.3B total / 2.7B active; the requested “Qwen2.5-MoE-A2.7B” repo name was not found. [card](https://huggingface.co/Qwen/Qwen1.5-MoE-A2.7B)
-- **WizardLM-2 8x22B:** official repo access returned 401; an HF mirror identifies it as 141B MoE based on Mixtral-8x22B. Use 141B only with `source_confidence=mirror`; keep architecture null until official config access. irror](https://huggingface.co/alpindale/WizardLM-2-8x22B)
-- **Pixtral 12B:** Mistral marks Pixtral 12B as no longer maintained/replaced; retain as a historical compatibility row. [status](https://mistral.ai/news/pixtral-12b/)
-
-## Closed API models (pricing-only, detailed pricing deferred)
-
-Do not add local architecture/inference rows for GPT-4o/GPT-4o-mini/o1/o1-mini/o3-mini, Claude 3.5 Sonnet/Haiku/Claude 3 Opus, or Gemini 2.0 Flash/1.5 Pro/1.5 Flash. Add versioned pricing records with `provider`, `model_id`, `input_usd_per_million`, `output_usd_per_million`, cached-input price, effective date, and deprecation status. Pricing research is intentionally deferred to the parent API-pricing track.
-
-## Suggested schema and implementation priorities
-
-Store `total_params` separately from `active_params`: memory sizing uses total weights, while MoE per-token compute uses active experts plus shared/trunk compute. Store both `context_config` and `context_advertised`, plus `release_date_type`, `source_checked_at`, `status`, and `source_confidence`. Must-have first: Qwen3 dense/MoE, DeepSeek V3/R1, Llama 4 Scout/Maverick, Gemma 3, Phi-4, Qwen2.5 Coder, Codestral, BGE-M3/E5, and Qwen2.5-VL. Nice: OLMo-2, Falcon3, Yi1.5, InternLM2.5, Pixtral, InternVL2, CogVLM2, Whisper Turbo, Parakeet. Future/status-only: Behemoth, unverified V3.5/R2, requested Qwen2.5-MoE alias, and official WizardLM-2 until accessible.
-
-
----
-
-# tokcalc Section C/E evidence ledger (snapshot 2026-09-20)
-
-## Conventions
-Official peak FLOPS values are theoretical. NVIDIA/AMD pages frequently publish 2:4 sparsity; dense = one-half of sparse only when footnote says so. Rows explicitly state per-chip vs system. Prices are dynamic, region/tier dependent; capture date 2026-09-20 IST. N/P means not publicly listed in the source, not zero.
-
-## Section C — accelerators
-
-![AMD Instinct MI355X product image](https://www.amd.com/content/dam/amd/en/images/products/data-centers/3366850-instinct-accelerator-mi350x-prod-front.jpg)
-
-Official visual: [NVIDIA RTX PRO 6000 Blackwell family](https://www.nvidia.com/en-us/products/workstations/professional-desktop-gpus/rtx-pro-6000-family/).
-
-
-| Vendor/product (status; year) | Memory / bandwidth | Dense FP16/BF16 | Interconnect | Benchmark evidence | Official source |
-|---|---|---|---|---|---|
-| NVIDIA H200 SXM / NVL (shipping; 2024) | 141 GB HBM3e, 4.8 TB/s | SXM 1,979 TFLOPS each FP16/BF16; NVL 1,671 TFLOPS | NVLink differs by form factor; use SKU-specific datasheet | N/P on official spec page | [H200 GPU](https://www.nvidia.com/en-us/data-center/h200), [H200 datasheet](https://resources.nvidia.com/en-us-gpu-resources/hpc-datasheet-sc23) |
-| NVIDIA B200 SXM (shipping in HGX/DGX systems; 2025) | 180 GB HBM3e, ~7.7–8.0 TB/s (official DGX gives 1,440 GB/64 TB/s for 8 GPUs) | Current official page exposes FP4/FP8 system metrics but not a clean FP16/BF16 dense row; store N/P until SKU datasheet is verified. Do not use AI TOPS or FP8 as FP16. | 5th-gen NVLink; DGX B200 14.4 TB/s aggregate NVLink | N/P in official page | [NVIDIA B200/HGX table](https://www.nvidia.com/en-us/data-center/b200), [DGX B200](https://www.nvidia.com/en-us/data-center/dgx-b200/) |
-| NVIDIA B300 SXM (shipping/available in 2026 cloud listings; 2025 announcement) | 288 GB HBM3e, 8 TB/s | DGX B300 official page gives FP4 144 sparse/108 dense and FP8 72 sparse; it does not expose FP16/BF16 dense. Store N/P rather than infer from FP8. | 5th-gen NVLink; DGX B300 14.4 TB/s aggregate | N/P | [DGX B300](https://www.nvidia.com/en-us/data-center/dgx-b300), [B300/HGX table](https://www.nvidia.com/en-us/data-center/b200) |
-| NVIDIA GB200 NVL72 system (shipping announced systems; 2025) | System: 13.4 TB HBM3e GPU memory, 576 TB/s; one GB200 superchip: 372 GB HBM3e, 16 TB/s | 360 PFLOPS FP16/BF16 shown for NVL72 in sparse format => ~180 PFLOPS dense; superchip 10 PFLOPS shown, verify footnote before storing | NVLink 130 TB/s system; 3.6 TB/s/superchip | N/P official | [GB200 NVL72](https://www.nvidia.com/en-us/data-center/gb200-nvl72/) |
-| NVIDIA GB300 NVL72 (announced/availability status SKU-dependent; 2025/2026) | N/P in official source reviewed; do not borrow B300 or GB200 values | N/P | N/P | N/P | [DGX B300](https://www.nvidia.com/en-us/data-center/dgx-b300), [Together GPU pricing](https://www.together.ai/pricing) (GB300 row shown —, not a spec source) |
-| NVIDIA RTX PRO 6000 Blackwell Workstation/Server/Max-Q (shipping; 2025) | 96 GB GDDR7 ECC; server product lists 1,597 GB/s | FP16/BF16 dense N/P in official page | PCIe Gen5 x16 | N/P | [RTX PRO 6000 family](https://www.nvidia.com/en-us/products/workstations/professional-desktop-gpus/rtx-pro-6000-family/), [server specs](https://www.nvidia.com/en-us/data-center/rtx-pro-6000-blackwell-server-edition/) |
-| NVIDIA RTX 5000 Ada workstation (shipping; 2023) | 32 GB GDDR6 ECC; official page does not expose bandwidth in extracted text | N/P (page gives 65.3 FP32 and 1,044.4 Tensor performance, not dense FP16/BF16) | PCIe Gen4 x16 | N/P | [RTX 5000 Ada](https://www.nvidia.com/en-us/products/workstations/rtx-5000/), [datasheet](https://resources.nvidia.com/en-us-briefcase-for-datasheets/rtx-5000-datashe?ncid=no-ncid) |
-| NVIDIA RTX 4500 Ada workstation (shipping; 2023) | 24 GB GDDR6 ECC; bandwidth N/P official page | N/P (634.0 Tensor listed, not FP16/BF16 dense) | PCIe Gen4 x16 | N/P | [RTX 4500 Ada](https://www.nvidia.com/en-us/products/workstations/rtx-4500/), [datasheet](https://www.nvidia.com/content/dam/en-zz/Solutions/products/workstations/nvidia-rtx-4500-datasheet.pdf) |
-| NVIDIA RTX 5090 consumer (shipping; 2025) | 32 GB GDDR7, 1,792 GB/s | N/P official FP16/BF16 (AI TOPS is not interchangeable) | N/P | N/P | [RTX 5090](https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5090/) |
-| NVIDIA RTX 5080 consumer (shipping; 2025) | 16 GB GDDR7, 960 GB/s | N/P official FP16/BF16 | N/P | N/P | [RTX 5080](https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5080) |
-| NVIDIA RTX 4080 Super consumer (shipping; 2024) | 16 GB GDDR6X, 736 GB/s | N/P official FP16/BF16 | N/P | N/P | [NVIDIA GeForce 40 series](https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/) |
-| NVIDIA RTX 4070 Ti Super consumer (shipping; 2024) | 16 GB GDDR6X, 672 GB/s | N/P official FP16/BF16 | N/P | N/P | [NVIDIA GeForce 40 series](https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/) |
-| AMD Instinct MI300X (shipping; 2023/2024) | 192 GB HBM3, 5.325 TB/s | 1,307.4 TFLOPS FP16 and BF16 dense | 7 x 128 GB/s Infinity Fabric links; PCIe Gen5 x16 | N/P official | [MI300X product](https://www.amd.com/en/products/accelerators/instinct/mi300/mi300x.html), [datasheet PDF](https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/data-sheets/amd-instinct-mi300x-data-sheet.pdf) |
-| AMD Instinct MI325X (shipping; 2024) | 256 GB HBM3E, 6 TB/s | 1,307.4 TFLOPS FP16/BF16 dense (official page) | N/P in extracted product page | N/P | [MI325X](https://www.amd.com/en/products/accelerators/instinct/mi300/mi325x.html), [datasheet](https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/instinct-mi325x-datasheet.pdf) |
-| AMD Instinct MI350X (shipping/launch 2025) | 288 GB HBM3E, 8 TB/s | Product page shows 4.6 PFLOPS FP16/BF16 with sparsity; dense ~2.3 PFLOPS (only if applying AMD sparse footnote; store both) | N/P product page; platform data required | N/P | [MI350X](https://www.amd.com/en/products/accelerators/instinct/mi350/mi350x.html), [AMD 2025 blog](https://www.amd.com/en/blogs/2025/amd-instinct-mi350-series-and-beyond-accelerating-the-future-of-ai-and-hpc.html) |
-| AMD Instinct MI355X (shipping/launch 2025) | 288 GB HBM3E, 8 TB/s | Official page shows 5.0 PFLOPS FP16/BF16 with sparsity; dense ~2.5 PFLOPS (derived half) | Platform: 8-GPU 2.3 TB total; 1,194.8 GB/s aggregate bidirectional peer-to-peer | N/P | [MI355X](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html), [platform](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x/platform.html) |
-| Intel Gaudi 2 (shipping; 2022) | 96 GB HBM2e, 2.45 TB/s; 48 MB SRAM | Official architecture page gives memory but not clean dense BF16/FP16 number in extracted text; keep N/P rather than infer | 24 x 100GbE RoCE RDMA NICs | Intel published comparative benchmarks; capture separately | [Gaudi architecture](https://docs.habana.ai/en/latest/Gaudi_Overview/Gaudi_Architecture.html), [Gaudi2 white paper](https://cdrdv2-public.intel.com/839363/Intel-Gaudi2-AI-Accelerators-whitepaper.pdf) |
-| Intel Gaudi 3 (shipping/PCIe available; 2024; expanded availability 2025) | 128 GB HBM2e, 3.7 TB/s; 96 MB SRAM | 1.678 PFLOPS BF16 matrix (official Intel brief) | 12 x 200GbE; PCIe Gen5 x16 128 GB/s bidirectional; 1,200 GB/s accelerator interconnect in Intel comparison | Intel performance/positioning PDF includes Llama 3 8B/70B/405B test matrix; numbers need SKU/config extraction | [Gaudi 3 architecture](https://docs.habana.ai/en/latest/Gaudi_Overview/Gaudi_Architecture.html), [PCIe brief](https://cdrdv2-public.intel.com/817488/Gaudi%203%20PCIe%20Product%20Brief_RB_1_V6.pdf), [availability](https://newsroom.intel.com/artificial-intelligence/intel-gaudi-3-expands-availability-drive-ai-innovation-scale) |
-| Google TPU v5e (shipping/GA; 2023) | 16 GB HBM, 800 GiB/s | 197 TFLOPS BF16/chip | 400 GB/s bidirectional ICI/chip; 256-chip pod; 50.63 PFLOPS/pod | N/P official LLM tok/s | [v5e docs](https://docs.cloud.google.com/tpu/docs/v5e) |
-| Google TPU v5p (shipping/GA; 2023) | 95 GiB HBM, 2,765 GB/s | 459 TFLOPS BF16/chip | 1,200 GB/s bidirectional ICI/chip; 8,960-chip pod | N/P official LLM tok/s | [v5p docs](https://docs.cloud.google.com/tpu/docs/v5p), [launch](https://cloud.google.com/blog/products/ai-machine-learning/introducing-cloud-tpu-v5p-and-ai-hypercomputer) |
-| Google TPU v6e Trillium (GA Dec 2024; shipping) | 32 GB HBM; ~1,638 GB/s (Google page gives doubled v5e bandwidth; v6e docs expose 1,638 GB/s) | 918 TFLOPS BF16/chip | 800 GB/s bidirectional ICI/chip; up to 256 chips/pod | Google says up to 4.7x peak compute/chip vs v5e | [v6e docs](https://docs.cloud.google.com/tpu/docs/v6e), [GA release](https://cloud.google.com/blog/products/compute/trillium-tpu-is-ga) |
-| Google TPU v7x Ironwood (GA/available in Google docs by 2026; 2025/2026) | 192 GiB HBM, 7,380 GB/s | 2,307 TFLOPS BF16/chip | 1,200 GB/s bidirectional ICI/chip; 9,216 chips/pod | Google TPU page says 42.5 exaflops/pod; system-level | [TPU7x docs](https://docs.cloud.google.com/tpu/docs/tpu7x), [TPU landing page](https://cloud.google.com/tpu) |
-| Groq LPU (shipping cloud; architecture generation/SKU varies) | Groq says on-chip SRAM bandwidth >80 TB/s; exact per-chip capacity/FP16 FLOPS not disclosed on reviewed page | N/P; do not substitute FP8 rack number | Platform page: 256 LPUs/rack, 40 PB/s SRAM bandwidth, 315 PFLOPS FP8/rack (system) | Artificial Analysis: Llama 3 70B 284 tok/s; Groq later docs show Llama 3.3 70B ~280 tok/s; speculative endpoint 1,665 tok/s (different model/config) | [Groq Llama 3 benchmark](https://groq.com/blog/12-hours-later-groq-is-running-llama-3-instruct-8-70b-by-meta-ai-on-its-lpu-inference-enginge), [LPU](https://groq.com/blog/the-groq-lpu-explained), [platform](https://groq.com/platform), odel docs](https://console.groq.com/docs/model/llama-3.3-70b-versatile) |
-| Cerebras WSE-3 / CS-3 (shipping; 2024) | CS-3 system: 44 GB on-chip SRAM, 21 PB/s memory bandwidth | WSE-3/CS-3: 125 PFLOPS peak AI performance is system/chip marketing metric, not directly dense FP16/BF16; mark N/P for exact dense | CS-3: 214 Pb/s interconnect bandwidth | Cerebras Inference: 1,800 tok/s Llama 3.1 8B and 450 tok/s Llama 3.1 70B; benchmark is service/system-level | [CS-3 system](https://www.cerebras.ai/system), [WSE-3 release](https://www.cerebras.ai/press-release/cerebras-announces-third-generation-wafer-scale-engine), [inference benchmark](https://www.cerebras.ai/blog/introducing-cerebras-inference-ai-at-instant-speed) |
-| SambaNova RDU/SN40L (shipping cloud; 2024 generation) | Exact capacity/bandwidth and clean dense FP16/BF16 not verified from an official accessible source in this run | N/P | N/P | No official Llama 3 throughput row verified; do not fabricate | [SambaNova platform](https://sambanova.ai/technology) (spec gap; revisit with browser/tab if needed) |
-| Apple M2 Ultra (shipping; 2023) | Unified memory 192 GB max; >800 GB/s bandwidth (Apple Mac Studio page) | Apple does not publish FP16/BF16 dense TFLOPS in reviewed sources | Unified memory, no NVLink; UltraFusion interconnect details not required for single chip | N/P official LLM tok/s | [M2 Ultra](https://www.apple.com/newsroom/2023/06/apple-unveils-m2-ultra/), [Mac Studio](https://www.apple.com/newsroom/2023/06/apple-unveils-new-mac-studio-and-mac-pro/) |
-| Apple M3 Ultra (shipping; 2025) | Unified memory 96–512 GB; >800 GB/s unified bandwidth (Mac Studio page) | Apple does not publish FP16/BF16 dense TFLOPS | Unified memory; no NVLink | N/P | [M3 Ultra](https://www.apple.com/newsroom/2025/03/apple-reveals-m3-ultra-taking-apple-silicon-to-a-new-extreme), [Mac Studio](https://www.apple.com/newsroom/2025/03/apple-unveils-new-mac-studio-the-most-powerful-mac-ever/) |
-| Apple M4 Ultra | No official Apple M4 Ultra shipping/announcement evidence verified in this run; mark unavailable rather than assume | N/P | N/P | N/P | Apple Newsroom search found M4 consumer products, not M4 Ultra; keep status unresolved |
-| NVIDIA Tesla V100 (still installed/cloud; launched 2017) | 16/32 GB HBM2, 900 GB/s PCIe or 1,134 GB/s V100S; NVLink 300 GB/s bidirectional | Tensor FP16 112 TFLOPS PCIe / 125 TFLOPS SXM2 (marketing tensor metric; document as tensor, not scalar dense) | PCIe 32 GB/s; NVLink 300 GB/s | NVIDIA app guide: frameworks up to 50x vs P100 (system/framework benchmark, not LLM) | [V100 datasheet](https://images.nvidia.com/content/technologies/volta/pdf/tesla-volta-v100-datasheet-letter-fnl-web.pdf), [V100 page](https://www.nvidia.com/en-gb/data-center/tesla-v100) |
-| NVIDIA Tesla P100 (legacy/hobbyist; launched 2016) | 12/16 GB HBM2, 549/732 GB/s | 18.7 TFLOPS PCIe or >21 TFLOPS native half (variant-dependent) | PCIe Gen3; no NVLink on PCIe card; SXM2 NVLink context differs | NVIDIA guide: frameworks up to 3x vs K80 | [P100 PCIe datasheet](https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/tesla-p100/pdf/nvidia-tesla-p100-PCIe-datasheet.pdf), [P100 page](https://www.nvidia.com/en-au/data-center/tesla-p100/) |
-| NVIDIA Tesla K80 (legacy/hobbyist; launched 2014) | 24 GB GDDR5 aggregate (12 GB/GPU), 480 GB/s aggregate | N/P official FP16; 8.73 TFLOPS FP32 aggregate/board | PCIe Gen3; dual-GPU board | NVIDIA says up to 2x application throughput with two onboard GPUs | [K80 page](https://www.nvidia.com/en-gb/data-center/tesla-k80), [K80 board spec](https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/tesla-product-literature/Tesla-K80-BoardSpec-07317-001-v05.pdf) |
-
-### Section C implementation notes
-- Add `dense_fp16_tflops`, `dense_bf16_tflops`, `sparse_fp16_bf16_tflops`, `metric_scope` (`chip`, `board`, `system`), `memory_capacity_gb`, `memory_type`, `memory_bandwidth_gbps`, `interconnect_type`, `interconnect_bandwidth_gbps`, `release_year`, `shipping_status`, `benchmark_tokens_s`, `benchmark_model`, `benchmark_config`, `benchmark_source`, `as_of`.
-- Never put AI TOPS, FP8, FP4, sparse, or system PFLOPS into the dense FP16/BF16 field. For AMD/NVIDIA sparse rows, retain sparse value and derive dense only when vendor footnote explicitly says 2x.
-- Apple unified memory is not VRAM; use `memory_scope=unified` and note CPU/GPU shared pool.
-
-## Section E — cloud pricing snapshot (USD; capture 2026-09-20; rates volatile)
-
-Prices below are exact search/extraction outputs from direct provider pages; provider pages can show different tiers/regions at different times. `—` means no current public rate verified, not that capacity never exists.
-
-| Provider + direct page | H100 80GB | H200 | A100 80GB | B200 | L40S | RTX 4090 | MI300X | Mac M2 Ultra | Billing/caveat |
-|---|---:|---:|---:|---:|---:|---:|---:|---:|---|
-| RunPod [pricing](https://www.runpod.io/pricing), [GPU models](https://www.runpod.io/gpu-models), [comparison](https://www.runpod.io/articles/comparison/choosing-gpus) | $4.79/hr serverless listing (dedicated/community varies) | $3.59/hr GPU-model snapshot; $4.31/hr clusters | $1.59/hr PCIe comparison; cluster page $1.79 SXM | $5.98/hr GPU-model snapshot; comparison $6.79 | $1.09/hr comparison | $0.34/hr Community article; product page says from $0.34 (another page headline $0.74) | — | — | Per-second; Community/Secure/Serverless/Cluster tiers and region supply change rate |
-| Lambda [instances](https://lambda.ai/instances) | $3.99/GPU-hr SXM | — | $2.79/GPU-hr 80GB SXM in 8-GPU plan | $6.69/GPU-hr | — | — | — | — | Pay by minute; A100 80GB price is per GPU within 8-GPU instance |
-| Modal [pricing](https://modal.com/pricing) | $0.001097/s = $3.9492/hr | $0.001261/s = $4.5396/hr | $0.000694/s = $2.4984/hr | $0.001736/s = $6.2496/hr | $0.000542/s = $1.9512/hr | — | — | — | Per-second compute; exact page is dynamic |
-| Vast.ai [pricing](https://vast.ai/pricing) | H100 SXM start $1.73, median $2.67/hr | H200 start $1.98, median $4.69/hr | A100 SXM start $0.20, median $0.80; PCIe start $0.33, median $0.78 | B200 start $6.25, median $8.13/hr | live guide ~$0.47 start/$0.53 median | live guide ~$0.13 start (median not captured) | — | — | Marketplace; on-demand per-second, interruptible 50%+ cheaper, reserved up to 50% off; location/host quality matters |
-| Together AI [pricing](https://www.together.ai/pricing), [GPU clusters](https://www.together.ai/gpu-clusters) | $3.99/GPU-hr on-demand; $3.19 reserved | $5.99/GPU-hr | — | HGX B200 $8.19/GPU-hr | — | — | — | — | Cluster service, typically 8–256 GPU scale; reserved terms differ |
-| Replicate [pricing](https://replicate.com/pricing), [L40S announcement](https://replicate.com/blog/nvidia-l40s-gpus-are-here) | $0.006100/s = $21.96/hr (single H100 listing) | pricing page lists H200 but amount not captured in extraction | — | — | $3.51/hr historical public-model hardware price | — | — | — | Per-second/request execution; multi-GPU H100 listed $0.0122/s = $43.92/hr; public/private model rates can differ |
-| CoreWeave [pricing](https://www.coreweave.com/pricing) | Official current page dynamic; no exact H100 amount extracted; third-party normalization $6.16/GPU-hr from $49.24 8-GPU node | third-party normalization $6.31/GPU-hr from $50.44 8-GPU node | third-party normalized $1.19/GPU-hr | $68.80/hr on-demand / $34.87 spot (node scope must be confirmed) | — | — | — | — | 8-GPU HGX minimum is common; use provider page to verify current region/node |
-| TensorDock [cloud GPU table](https://www.tensordock.com/cloud-gpus.html) | $2.25/hr H100 SXM5 | — | $1.80/hr SXM4; $1.50/hr PCIe | — | $0.95/hr L40 (not L40S; do not relabel) | $0.35/hr (site has a $0.37 product headline) | — | — | Typical hourly, varies by host; resources not included |
-| Hugging Face Endpoints [pricing](https://huggingface.co/docs/inference-endpoints/en/pricing), [pricing page](https://huggingface.co/pricing) | $10/hr (GCP H100 x1 endpoint table) | — | $2.50/hr A100 large (HF pricing page; endpoint table may vary) | — | — | — | — | — | Endpoint compute; provider/region and scale-to-zero settings matter |
-| AWS EC2 [P5](https://aws.amazon.com/ec2/instance-types/p5/), [on-demand](https://aws.amazon.com/ec2/pricing/on-demand), [capacity blocks](https://aws.amazon.com/ec2/capacityblocks/pricing/) | P5.48xlarge 8x H100: $55.04/hr on-demand => $6.88/GPU-hr (third-party link to official); Capacity Blocks examples $41.528 instance/$5.191 GPU Atlanta, $37.76/$4.720 Sydney/London | P5e/P5en supports 8x H200 (1128 GB total) but exact public rate not extracted | P4d page exists but exact current 80GB rate not extracted | — | G5/G6 prices not extracted | — | — | — | On-demand vs Capacity Blocks differs; region, OS, tenancy and egress excluded |
-| Google Cloud [GPU pricing](https://cloud.google.com/products/compute/gpus-pricing), [TPU pricing](https://cloud.google.com/tpu/pricing) | A3/H100 exact current rate not extracted from official table | A3 Ultra/H200 exact rate not extracted | — | A4/B200 exact rate not extracted | — | — | — | — | Public calculator/table is region and VM-shape dependent; do not use nonofficial estimate |
-| Azure [VM pricing](https://azure.microsoft.com/en-us/pricing/details/virtual-machines/linux/) | ND H100 v5 exact current rate not extracted | ND H200 v5 exact current rate not extracted | — | — | — | — | — | — | Region, Linux/Windows, reservation/spot matter; mark unavailable until calculator query |
-| Oracle Cloud [GPU compute](https://www.oracle.com/cloud/compute/gpu/) | Official exact public rate not extracted (third-party reports $10/hr; do not treat as official) | — | third-party reports $4/hr; not verified official | — | — | — | 8x MI300X node third-party $48/hr = $6/GPU-hr, not official Oracle page | — | OCI shape pricing, region and tenancy; verify in OCI cost estimator |
-
-### Google TPU prices (useful for calculator)
-- v5e: $1.20/chip-hour on-demand, us-central1; v5p: $4.20/chip-hour on-demand, us-east1/us-east5; Trillium v6e: $2.70/chip-hour on-demand in us-east1/us-east5; Ironwood table shows $12.00/chip-hour us-central1. Prices are from [Google Cloud TPU pricing](https://cloud.google.com/tpu/pricing), with reservation/commitment columns lower than on-demand. v5e/v5p/v6e rates are chip-hour, not pod-hour.
-
-### Pricing interpretation
-- Treat rates as timestamped observations, not stable constants. Store `provider`, `gpu_sku`, `scope` (per GPU/per node/per endpoint), `billing_unit`, `tier`, `region`, `captured_at`, `source_url`, `price_usd`, `availability`, and `notes`.
-- Directly missing providers/GPUs must remain null. Do not copy a H100 rate to H200, MI300X or Mac M2 Ultra.
-
-## Access gaps / unsuccessful attempts
-- Direct extraction timed out for several dynamic provider pages (RunPod, Lambda, Modal, Vast, Replicate, CoreWeave, TensorDock, AWS, Google, Azure, Oracle); search indexing exposed current table snippets but dynamic pages require browser/tab or provider calculators for a fully reproducible snapshot.
-- NVIDIA H200 and Google TPU pages intermittently timed out; official indexed datasheet snippets supplied H200 compute and TPU specs.
-- SambaNova official RDU exact numeric spec/LLM benchmark and M4 Ultra shipping status were not verified; mark unavailable.
-- No official exact current rates were found for Together A100/L40S/4090/MI300X/Mac, HF H200/B200 etc.; preserve nulls.
-- Apple does not publish FP16/BF16 dense TFLOPS in reviewed pages; do not invent from GPU-core counts.
-
-
----
-
-# Section D — More Quantization Formats (tokcalc)
-
-Research date: 2026-09-20. Status: best effort, source-backed within the primary/official sources listed below. Quantization quality and speed are highly model-, calibration-, engine-, GPU-, batch-, context-, and kernel-dependent. Do not present any single benchmark as a universal factor.
-
-## 1. GGUF / llama.cpp variants
-
-GGUF (GPT-Generated Unified Format, as named by the official specification) is the file/container format used by llama.cpp; these are block-quantized weight schemes, usually WnA16 at inference (integer/FP weights with dequantization into FP16/BF16 compute). Source: [GGUF specification](https://github.com/ggml-org/ggml/blob/master/docs/gguf.md). The official llama.cpp quantizer reports effective bits/weight (including scale/metadata overhead), model size, and benchmark speeds. Source: [llama.cpp quantize README](https://raw.githubusercontent.com/ggml-org/llama.cpp/master/tools/quantize/README.md). The legacy per-variant PPL deltas below come from llama.cpp's `quantize.cpp` table for Llama-3-8B; they are not universal. Source: [quantize.cpp](https://raw.githubusercontent.com/ggml-org/llama.cpp/master/tools/quantize/quantize.cpp).
-
-### Official Llama-3.1-8B GGUF benchmark table
-
-The current README's FP16 reference is 14.96 GiB, 16.0005 bpw, 29.17 generated tokens/s; the quantized rows are the same benchmark run (prompt 512, generation 128). Size reduction and decode speedup are calculated from those published values: `1 - size/14.96` and `gen_tps/29.17`. They are a model-dependent llama.cpp reference, not a generic promise.
-
-| Variant | Effective bpw | Size GiB | Approx reduction vs FP16 | Published gen t/s | Derived decode speedup vs FP16 | Accuracy/perplexity evidence and caveat |
-|---|---:|---:|---:|---:|---:|---|
-| Q2_K | 3.1593 | 2.95 | 80.3% | 79.85 | 2.74x (+174%) | Legacy Llama-3-8B table: +3.5199 PPL; severe quality loss at this level. |
-| Q3_K_S | 3.6429 | 3.41 | 77.2% | 69.84 | 2.39x (+139%) | Legacy Llama-3-8B: +1.6321 PPL; low-bit degradation can be task-visible. |
-| Q3_K_M | 3.9960 | 3.74 | 75.0% | 71.68 | 2.46x (+146%) | Legacy Llama-3-8B: +0.6569 PPL. |
-| Q4_0 | approximately 4 (legacy effective bpw varies by tensor/metadata) | 4.34 | 71.0% | not published in current README row | not quantified | Legacy Llama-3-8B: +0.4685 PPL; older/simple scheme. |
-| Q4_1 | approximately 4 | 4.78 | 68.0% | not published in current README row | not quantified | Legacy Llama-3-8B: +0.4511 PPL. |