@tokcalc/mcp-server 0.1.3 → 0.2.0-alpha.1

package/tool-results/read_1789888163087_ccc406d47505.txt

@@ -1,122 +0,0 @@
-   121→
-   122→## 10. Vision-language/image tokens
-   123→- **Definition:** Image preprocessing converts pixels/patches/tiles into visual tokens or embeddings that consume prefill compute, KV memory, context, and often billable input tokens.
-   124→- **User value:** Avoid severe underestimation of multimodal TTFT, memory, and API cost; support image count, resolution, detail level, frame sampling, and token pruning.
-   125→- **Complexity / priority:** High / Must-have if VLM models are supported.
-   126→- **Quantitative evidence:** Gemini docs allocate 258 tokens for images with both dimensions ≤384 px; larger images are tiled to 768×768, each tile costing 258 tokens, with a crop-unit/tile formula. [Gemini image understanding](https://ai.google.dev/gemini-api/docs/image-understanding)
-   127→- OpenAI's current vision docs specify 32×32 patch tokenization for applicable models: `patch_count = ceil(width/32) × ceil(height/32)`, then model/detail-specific patch budgets/resizing; images count toward input token and TPM limits. [OpenAI images/vision](https://platform.openai.com/docs/guides/images-vision.md)
-   128→- vLLM supports content-hash or stable-ID multimodal caching and video token pruning, useful for local serving formulas. [vLLM multimodal inputs](https://docs.vllm.ai/en/stable/features/multimodal_inputs/)
-   129→- **Formula implications:** `total_prefill_tokens = text_tokens + Σ(image_tokens) + Σ(video_frame_tokens)`; cost = total billable input × input rate; KV memory applies after projected visual tokens enter the language backbone. Add resolution/detail/model-specific tokenizer tables.
-   130→- **Caveats:** Image-token rules are model/provider-specific and changing; don't use one universal “image = N tokens.” Llama/Qwen/Pixtral tokenization must be sourced per model card/processor.
-   131→
-   132→## 11. Training throughput & fine-tuning
-   133→- **Definition:** A training calculator estimates forward/backward FLOPs, optimizer/activation/parameter memory, wall time, and cost for full SFT, LoRA, and QLoRA.
-   134→- **User value:** Users can choose feasible GPUs and compare fine-tuning economics before provisioning.
-   135→- **Complexity / priority:** High / Nice (Future full trainer; adapter estimator sooner).
-   136→- **Quantitative evidence:** Chinchilla's paper trained >400 models spanning 70M–16B parameters and 5B–500B tokens; its compute-optimal finding is to scale model size and training-token count approximately equally under a fixed compute budget. [Chinchilla paper](https://arxiv.org/abs/2203.15556)
-   137→- LoRA reports up to 10,000× fewer trainable parameters and 3× lower GPU memory vs GPT-3 full fine-tuning with Adam in its evaluated setup. [LoRA paper](https://arxiv.org/abs/2106.09685)
-   138→- QLoRA reports fine-tuning a 65B model on one 48GB GPU; its paper describes reducing >780GB average memory for 16-bit fine-tuning to <48GB in the evaluated setup. [QLoRA paper](https://arxiv.org/html/2305.14314v1)
-   139→- **Formula implications:** First approximation for dense decoder training compute is proportional to `6 × parameters × training_tokens`; show as an assumption, then calibrate with measured FLOPs/utilization. LoRA trainable params = sum over adapted matrices `r·(d_in+d_out)`; QLoRA adds quantized frozen weights plus adapter/optimizer/activation memory.
-   140→- **Caveats:** 6ND is an approximation; attention, sequence length, activation checkpointing, optimizer, packing, MoE routing, and communication alter real cost. LoRA ratios are not universal.
-   141→
-   142→## 12. Build-vs-buy calculator
-   143→- **Definition:** Compare self-hosted GPU cost/latency/capacity against API pricing for the same input/output/workload distribution.
-   144→- **User value:** Directly answers whether utilization, latency/SLO, privacy, or operational complexity justifies owning/renting GPUs.
-   145→- **Complexity / priority:** Medium / Must-have.
-   146→- **Formula implications:** Self-host cost/request = `(GPU_hourly_cost × wall_time + CPU/RAM/egress/ops amortization)/requests`; per-million-token cost = hourly_cost / effective_tokens_per_hour × 1e6. API cost = uncached input×input_rate + cached input×cached_rate + output×output_rate + tool/media charges. Break-even volume solves self-host fixed+variable = API variable.
-   147→- **Required knobs:** utilization, concurrency, TTFT/TPOT SLO, prompt/output distributions, cache hit rate, quantization, replicas/HA, region/egress, idle/cold-start time, and API batch discounts.
-   148→- **Caveats:** Prices change quickly and throughput benchmarks are not apples-to-apples; link every provider/model price and timestamp it. No universal demand statistic was verified, but this feature follows directly from the cost equations and existing tokcalc scope.
-   149→
-   150→## 13. Energy / carbon per million tokens
-   151→- **Definition:** Attribute measured/estimated electricity and regional carbon intensity to prefill/decode work, then normalize by tokens.
-   152→- **User value:** Sustainability reporting and energy-aware model/GPU selection; helps expose long-context/reasoning cost not visible in dollars.
-   153→- **Complexity / priority:** Medium–High / Nice.
-   154→- **Quantitative evidence:** A 2025 infrastructure-aware benchmark gives `Carbon (kgCO2e) = E_query × CIF` and separates prompt-level operational footprint; it reports ~1.14 gCO2e per 400-token query for Mistral Large 2 as aligned with Mistral's LCA, but this is workload/region-specific. [Hungry AI paper](https://arxiv.org/html/2505.09598v6) [Mistral LCA reference is linked in paper]
-   155→- CodeCarbon measures/estimates CPU, GPU, and RAM electricity and applies regional carbon intensity. [CodeCarbon](https://github.com/mlco2/codecarbon)
-   156→- **Formula implications:** `E_Wh = ∫ power_W dt / 3600`; `gCO2e = E_Wh × carbon_intensity_g/Wh × PUE`; report `gCO2e / 1e6 output_tokens` and optionally input/output separately. Include facility overhead and region as explicit fields.
-   157→- **Caveats:** API providers rarely publish per-request power; GPU TDP is not measured draw; utilization, batching, PUE, cooling, and grid mix dominate. I found no stable universal gCO2e/M-token constant.
-   158→
-   159→## 14. Serverless GPU cold starts
-   160→- **Definition:** Time from scale-to-zero request to a ready model worker/first token, including container/image pull, library init, weight transfer, CUDA graph capture, and model warmup.
-   161→- **User value:** Quantify tail latency and economics for bursty workloads; compare warm pool, snapshot, quantization, and scale-to-zero strategies.
-   162→- **Complexity / priority:** Medium / Nice.
-   163→- **Quantitative evidence:** Modal says model weights can load from a Volume at 1–2 GB/s, roughly nearly 1 second of cold-start latency per GB of weights; its high-performance guide reports GPU memory snapshots can yield 10x cold-start reductions. [Modal high-performance LLM inference](https://modal.com/docs/guide/high-performance-llm-inference)
-   164→- Modal's Ministral 3 test reports median cold start falling from ~118s to ~12s with GPU snapshotting. [Modal blog](https://modal.com/blog/mistral-3)
-   165→- RunPod's vLLM cold-start guide says uncached image pulls can take 30–90s; official RunPod materials advertise sub-200ms FlashBoot for active endpoints, which should be treated as a warm/snapshot path, not a generic model boot. [RunPod guide](https://www.runpod.io/blog/cut-vllm-cold-starts-runpod-serverless) [RunPod product](https://www.runpod.io/product/serverless)
-   166→- **Formula implications:** `cold_start ≈ image_pull + container_init + weight_load(model_GB / effective_GBps) + GPU_load + compile/capture + warmup`; amortize over requests per warm interval. Add p50/p95/p99, warm-worker fraction, snapshot support, model size, and provider.
-   167→- **Caveats:** Marketing numbers are platform/configuration-specific; exact cold-start distributions for Replicate/RunPod/Modal vary by region, cached image/model, GPU availability, and model. Treat every provider value as timestamped benchmark input, not a constant.
-   168→
-   169→## Cross-cutting implementation schema
-   170→Store per feature/model/provider: source URL, benchmark date, hardware, engine/version, model/quantization, prompt/output distributions, batch/concurrency, QPS, metric (TTFT/TPOT/ITL/throughput/cost/energy), and confidence. Keep measured benchmark multipliers separate from analytical estimates.
-   171→
-   172→## Gaps / failed attempts
-   173→- vLLM docs and vendor pages were readable, but several arXiv abstract pages and older dynamic docs timed out in extraction; equivalent official pages or arXiv results were used where content was available.
-   174→- No authoritative universal chunked-prefill speedup, agent tool-call latency multiplier, long-context 1M throughput multiplier, embedding market-demand figure, or universal energy/token constant was verified.
-   175→- OpenAI's public marketing pricing page returned 403 in direct fetch; the official developer pricing/prompt-caching docs were available and should be used for current model rates.
-   176→
-   177→
-   178→---
-   179→
-   180→# Tokcalc Section B — implementation-ready model catalog
-   181→
-   182→**Cutoff:** 2026-09-20. **Status:** best effort within the declared HF/API universe; not exhaustive of every community checkpoint. Architecture fields are taken from direct config JSON when readable. HF `createdAt` is a repository-date proxy, not necessarily announcement date. `n/a` means not disclosed or inaccessible; it must remain null in the calculator.
-   183→
-   184→## Open LLM, coding, and reasoning rows
-   185→
-   186→|Official HF model|Family|Total / active params|Layers|Hidden|Q / KV heads|Head dim|Vocab|Context|Release/date proxy|Sources|
-   187→|---|---|---:|---:|---:|---:|---:|---:|---:|---|---|
-   188→|[meta-llama/Llama-4-Scout-17B-16E-Instruct](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E-Instruct)|Llama 4|[~109B / 17B](https://huggingface.co/blog/llama4-release)|n/a|n/a|n/a / n/a|n/a|n/a|[10M advertised](https://developer.meta.com/ai/models/llama-4/)|[2025-04-05](https://huggingface.co/api/models/meta-llama/Llama-4-Scout-17B-16E-Instruct)|[card](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E-Instruct) · [config](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E-Instruct/raw/main/config.json)|
-   189→|[meta-llama/Llama-4-Maverick-17B-128E-Instruct](https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct)|Llama 4|[~400B / 17B](https://huggingface.co/blog/llama4-release)|n/a|n/a|n/a / n/a|n/a|n/a|[1M advertised](https://developer.meta.com/ai/models/llama-4/)|[2025-04-05](https://huggingface.co/api/models/meta-llama/Llama-4-Maverick-17B-128E-Instruct)|[card](https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct) · [config](https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct/raw/main/config.json)|
-   190→|[meta-llama/Llama-4-Behemoth-17B-16E-Instruct](https://huggingface.co/meta-llama/Llama-4-Behemoth-17B-16E-Instruct)|Llama 4|[~2T / 288B](https://ai.meta.com/blog/llama-4-multimodal-intelligence)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2025-04-05 announced](https://huggingface.co/api/models/meta-llama/Llama-4-Behemoth-17B-16E-Instruct)|[card](https://huggingface.co/meta-llama/Llama-4-Behemoth-17B-16E-Instruct) · [config](https://huggingface.co/meta-llama/Llama-4-Behemoth-17B-16E-Instruct/raw/main/config.json)|
-   191→|[Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B)|Qwen 3|[0.6B](https://huggingface.co/api/models/Qwen/Qwen3-0.6B)|[28](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[1024](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[16](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-0.6B)|[card](https://huggingface.co/Qwen/Qwen3-0.6B) · [config](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|
-   192→|[Qwen/Qwen3-4B](https://huggingface.co/Qwen/Qwen3-4B)|Qwen 3|[4B](https://huggingface.co/api/models/Qwen/Qwen3-4B)|[36](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[2560](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[32](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-4B)|[card](https://huggingface.co/Qwen/Qwen3-4B) · [config](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|
-   193→|[Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B)|Qwen 3|[8B](https://huggingface.co/api/models/Qwen/Qwen3-8B)|[36](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[4096](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[32](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-8B)|[card](https://huggingface.co/Qwen/Qwen3-8B) · [config](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|
-   194→|[Qwen/Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B)|Qwen 3|[14B](https://huggingface.co/api/models/Qwen/Qwen3-14B)|[40](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-14B)|[card](https://huggingface.co/Qwen/Qwen3-14B) · [config](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|
-   195→|[Qwen/Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B)|Qwen 3|[32B](https://huggingface.co/api/models/Qwen/Qwen3-32B)|[64](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[64](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-32B)|[card](https://huggingface.co/Qwen/Qwen3-32B) · [config](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|
-   196→|[Qwen/Qwen3-30B-A3B](https://huggingface.co/Qwen/Qwen3-30B-A3B)|Qwen 3|[30B](https://huggingface.co/api/models/Qwen/Qwen3-30B-A3B)|[48](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[2048](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[32](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-30B-A3B)|[card](https://huggingface.co/Qwen/Qwen3-30B-A3B) · [config](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|
-   197→|[Qwen/Qwen3-235B-A22B](https://huggingface.co/Qwen/Qwen3-235B-A22B)|Qwen 3|[235B](https://huggingface.co/api/models/Qwen/Qwen3-235B-A22B)|[94](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[4096](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[64](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-235B-A22B)|[card](https://huggingface.co/Qwen/Qwen3-235B-A22B) · [config](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|
-   198→|[Qwen/Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct)|Qwen 2.5-VL|[7B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-7B-Instruct)|[28](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[3584](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[28](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[2025-01-26](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-7B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|
-   199→|[Qwen/Qwen2.5-VL-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct)|Qwen 2.5-VL|[32B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-32B-Instruct)|[64](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[2025-03-21](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-32B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|
-   200→|[Qwen/Qwen2.5-VL-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct)|Qwen 2.5-VL|[72B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-72B-Instruct)|[80](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[8192](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[64](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[2025-01-27](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-72B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|
-   201→|[Qwen/Qwen2.5-MoE-A2.7B](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B)|Other|[n/a](https://huggingface.co/api/models/Qwen/Qwen2.5-MoE-A2.7B)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|n/a|[card](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B) · [config](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B/raw/main/config.json)|
-   202→|[Qwen/Qwen2.5-Coder-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct)|Qwen 2.5 Coder|[7B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-7B-Instruct)|[28](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[3584](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[28](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[2024-09-17](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-7B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|
-   203→|[Qwen/Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct)|Qwen 2.5 Coder|[14B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-14B-Instruct)|[48](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[2024-11-06](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-14B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|
-   204→|[Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)|Qwen 2.5 Coder|[32B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-32B-Instruct)|[64](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[2024-11-06](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-32B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|
-   205→|[deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3)|[61](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[2024-12-25](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3)|[card](https://huggingface.co/deepseek-ai/DeepSeek-V3) · [config](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|
-   206→|[deepseek-ai/DeepSeek-V3-0324](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3-0324)|[61](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[2025-03-24](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3-0324)|[card](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324) · [config](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|
-   207→|[deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1)|[61](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[2025-01-20](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1)|[card](https://huggingface.co/deepseek-ai/DeepSeek-R1) · [config](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|
-   208→|[deepseek-ai/DeepSeek-R1-0528](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1-0528)|[61](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[2025-05-28](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1-0528)|[card](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528) · [config](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|
-   209→|[deepseek-ai/DeepSeek-Coder-V2-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct)|DeepSeek Coder V2|[236B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Instruct)|[60](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[5120](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|n/a|[102400](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[2024-06-14](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Instruct)|[card](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct) · [config](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|
-   210→|[mistralai/Mistral-Large-Instruct-2411](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411)|Mistral|[122.6B](https://huggingface.co/api/models/mistralai/Mistral-Large-Instruct-2411)|[88](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[12288](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[96](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json) / [8](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[128](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[131072](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[2024-11-14](https://huggingface.co/api/models/mistralai/Mistral-Large-Instruct-2411)|[card](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411) · [config](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|
-   211→|[mistralai/Codestral-22B-v0.1](https://huggingface.co/mistralai/Codestral-22B-v0.1)|Mistral|[22.2B](https://huggingface.co/api/models/mistralai/Codestral-22B-v0.1)|[56](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[6144](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[48](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json) / [8](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|n/a|[32768](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[2024-05-29](https://huggingface.co/api/models/mistralai/Codestral-22B-v0.1)|[card](https://huggingface.co/mistralai/Codestral-22B-v0.1) · [config](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|
-   212→|[mistralai/Ministral-3B-Instruct-2410](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410)|Mistral|[3B](https://huggingface.co/api/models/mistralai/Ministral-3B-Instruct-2410)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2024-10; repo 401](https://huggingface.co/api/models/mistralai/Ministral-3B-Instruct-2410)|[card](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410) · [config](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410/raw/main/config.json)|
-   213→|[mistralai/Ministral-8B-Instruct-2410](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410)|Mistral|[8.0B](https://huggingface.co/api/models/mistralai/Ministral-8B-Instruct-2410)|[36](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[4096](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[32](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json) / [8](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[128](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[131072](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[2024-10-15](https://huggingface.co/api/models/mistralai/Ministral-8B-Instruct-2410)|[card](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410) · [config](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|
-   214→|[mistralai/Pixtral-12B-2409](https://huggingface.co/mistralai/Pixtral-12B-2409)|Pixtral|[12B](https://huggingface.co/api/models/mistralai/Pixtral-12B-2409)|n/a|n/a|n/a / n/a|n/a|n/a|[128K advertised](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|[2024-09](https://huggingface.co/api/models/mistralai/Pixtral-12B-2409)|[card](https://huggingface.co/mistralai/Pixtral-12B-2409) · [config](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|
-   215→|[google/gemma-3-1b-it](https://huggingface.co/google/gemma-3-1b-it)|Gemma 3|[1B](https://huggingface.co/api/models/google/gemma-3-1b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[32K](https://huggingface.co/google/gemma-3-1b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-1b-it)|[card](https://huggingface.co/google/gemma-3-1b-it) · [config](https://huggingface.co/google/gemma-3-1b-it/raw/main/config.json)|
-   216→|[google/gemma-3-4b-it](https://huggingface.co/google/gemma-3-4b-it)|Gemma 3|[4B](https://huggingface.co/api/models/google/gemma-3-4b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-4b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-4b-it)|[card](https://huggingface.co/google/gemma-3-4b-it) · [config](https://huggingface.co/google/gemma-3-4b-it/raw/main/config.json)|
-   217→|[google/gemma-3-12b-it](https://huggingface.co/google/gemma-3-12b-it)|Gemma 3|[12B](https://huggingface.co/api/models/google/gemma-3-12b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-12b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-12b-it)|[card](https://huggingface.co/google/gemma-3-12b-it) · [config](https://huggingface.co/google/gemma-3-12b-it/raw/main/config.json)|
-   218→|[google/gemma-3-27b-it](https://huggingface.co/google/gemma-3-27b-it)|Gemma 3|[27B](https://huggingface.co/api/models/google/gemma-3-27b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-27b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-27b-it)|[card](https://huggingface.co/google/gemma-3-27b-it) · [config](https://huggingface.co/google/gemma-3-27b-it/raw/main/config.json)|
-   219→|[google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it)|Gemma 2|[2B](https://huggingface.co/api/models/google/gemma-2-2b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-2b-it/raw/main/config.json)|[2024-07](https://huggingface.co/api/models/google/gemma-2-2b-it)|[card](https://huggingface.co/google/gemma-2-2b-it) · [config](https://huggingface.co/google/gemma-2-2b-it/raw/main/config.json)|
-   220→|[google/gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it)|Gemma 2|[9B](https://huggingface.co/api/models/google/gemma-2-9b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-9b-it/raw/main/config.json)|[2024-06](https://huggingface.co/api/models/google/gemma-2-9b-it)|[card](https://huggingface.co/google/gemma-2-9b-it) · [config](https://huggingface.co/google/gemma-2-9b-it/raw/main/config.json)|
-   221→|[google/gemma-2-27b-it](https://huggingface.co/google/gemma-2-27b-it)|Gemma 2|[27B](https://huggingface.co/api/models/google/gemma-2-27b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-27b-it/raw/main/config.json)|[2024-06](https://huggingface.co/api/models/google/gemma-2-27b-it)|[card](https://huggingface.co/google/gemma-2-27b-it) · [config](https://huggingface.co/google/gemma-2-27b-it/raw/main/config.json)|
-   222→|[microsoft/phi-4](https://huggingface.co/microsoft/phi-4)|Phi|[14.7B](https://huggingface.co/api/models/microsoft/phi-4)|[40](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[5120](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[40](https://huggingface.co/microsoft/phi-4/raw/main/config.json) / [10](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|n/a|[100352](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[16384](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[2024-12-11](https://huggingface.co/api/models/microsoft/phi-4)|[card](https://huggingface.co/microsoft/phi-4) · [config](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|
-   223→|[microsoft/Phi-4-mini-instruct](https://huggingface.co/microsoft/Phi-4-mini-instruct)|Phi|[3.8B](https://huggingface.co/api/models/microsoft/Phi-4-mini-instruct)|[32](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[3072](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[24](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json) / [8](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|n/a|[200064](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[2025-02-19](https://huggingface.co/api/models/microsoft/Phi-4-mini-instruct)|[card](https://huggingface.co/microsoft/Phi-4-mini-instruct) · [config](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|
-   224→|[microsoft/Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct)|Phi|[3.8B](https://huggingface.co/api/models/microsoft/Phi-3.5-mini-instruct)|[32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[3072](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json) / [32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|n/a|[32064](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[2024-08-16](https://huggingface.co/api/models/microsoft/Phi-3.5-mini-instruct)|[card](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) · [config](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|
-   225→|[microsoft/Phi-3.5-MoE-instruct](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct)|Phi|[41.9B](https://huggingface.co/api/models/microsoft/Phi-3.5-MoE-instruct)|[32](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[4096](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[32](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json) / [8](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|n/a|[32064](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[2024-08-17](https://huggingface.co/api/models/microsoft/Phi-3.5-MoE-instruct)|[card](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct) · [config](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|
-   226→|[WizardLM/WizardLM-2-8x22B](https://huggingface.co/WizardLM/WizardLM-2-8x22B)|WizardLM|[141B](https://huggingface.co/api/models/WizardLM/WizardLM-2-8x22B)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2024-04](https://huggingface.co/api/models/WizardLM/WizardLM-2-8x22B)|[card](https://huggingface.co/WizardLM/WizardLM-2-8x22B) · [config](https://huggingface.co/WizardLM/WizardLM-2-8x22B/raw/main/config.json)|
-   227→|[microsoft/Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b)|Orca|[n/a](https://huggingface.co/api/models/microsoft/Orca-2-13b)|[40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[5120](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json) / [40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|n/a|[32003](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[4096](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[2023-11-14](https://huggingface.co/api/models/microsoft/Orca-2-13b)|[card](https://huggingface.co/microsoft/Orca-2-13b) · [config](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|
-   228→|[microsoft/BitNet-b1.58-2B-4T](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T)|BitNet|[850M](https://huggingface.co/api/models/microsoft/BitNet-b1.58-2B-4T)|[30](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[2560](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[20](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json) / [5](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|n/a|[128256](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[4096](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[2025-04-15](https://huggingface.co/api/models/microsoft/BitNet-b1.58-2B-4T)|[card](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T) · [config](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|
-   229→|[HuggingFaceTB/SmolLM2-135M](https://huggingface.co/HuggingFaceTB/SmolLM2-135M)|SmolLM2|[135M](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-135M)|[30](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[576](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[9](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json) / [3](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[2024-10-31](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-135M)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-135M) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|
-   230→|[HuggingFaceTB/SmolLM2-360M](https://huggingface.co/HuggingFaceTB/SmolLM2-360M)|SmolLM2|[362M](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-360M)|[32](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[960](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[15](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json) / [5](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[2024-10-31](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-360M)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-360M) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|
-   231→|[HuggingFaceTB/SmolLM2-1.7B](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B)|SmolLM2|[1.7B](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-1.7B)|[24](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[2048](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[32](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json) / [32](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[2024-10-30](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-1.7B)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|
-   232→|[TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|TinyLlama|[1.1B](https://huggingface.co/api/models/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|[22](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2048](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[32](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json) / [4](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|n/a|[32000](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2048](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2023-12-30](https://huggingface.co/api/models/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|[card](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) · [config](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|
-   233→|[allenai/OLMo-2-1124-7B-Instruct](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct)|OLMo|[7.3B](https://huggingface.co/api/models/allenai/OLMo-2-1124-7B-Instruct)|[32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[4096](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json) / [32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|n/a|[100352](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[4096](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[2024-12-18](https://huggingface.co/api/models/allenai/OLMo-2-1124-7B-Instruct)|[card](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct) · [config](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|
-   234→|[tiiuae/Falcon3-7B-Instruct](https://huggingface.co/tiiuae/Falcon3-7B-Instruct)|Falcon 3|[7.5B](https://huggingface.co/api/models/tiiuae/Falcon3-7B-Instruct)|[28](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[3072](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[12](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[256](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[131072](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[2024-11-29](https://huggingface.co/api/models/tiiuae/Falcon3-7B-Instruct)|[card](https://huggingface.co/tiiuae/Falcon3-7B-Instruct) · [config](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|
-   235→|[01-ai/Yi-1.5-9B-Chat](https://huggingface.co/01-ai/Yi-1.5-9B-Chat)|Yi 1.5|[8.8B](https://huggingface.co/api/models/01-ai/Yi-1.5-9B-Chat)|[48](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[4096](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[32](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json) / [4](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|n/a|[64000](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[4096](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[2024-05-10](https://huggingface.co/api/models/01-ai/Yi-1.5-9B-Chat)|[card](https://huggingface.co/01-ai/Yi-1.5-9B-Chat) · [config](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|
-   236→|[internlm/internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)|InternLM 2.5|[7.7B](https://huggingface.co/api/models/internlm/internlm2_5-7b-chat)|[32](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[4096](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[32](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json) / [8](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|n/a|[92544](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[32768](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[2024-06-27](https://huggingface.co/api/models/internlm/internlm2_5-7b-chat)|[card](https://huggingface.co/internlm/internlm2_5-7b-chat) · [config](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|
-   237→|[deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|DeepSeek Coder V2|[16B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|[27](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[2048](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[16](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json) / [16](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|n/a|[102400](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[2024-06-14](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|[card](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct) · [config](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|
-   238→|[codellama/CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf)|CodeLlama|[6.7B](https://huggingface.co/api/models/codellama/CodeLlama-7b-hf)|[32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[4096](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json) / [32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|n/a|[32016](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[16384](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[2023-08-24](https://huggingface.co/api/models/codellama/CodeLlama-7b-hf)|[card](https://huggingface.co/codellama/CodeLlama-7b-hf) · [config](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|
-   239→|[codellama/CodeLlama-34b-Instruct-hf](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf)|CodeLlama|[33.7B](https://huggingface.co/api/models/codellama/CodeLlama-34b-Instruct-hf)|[48](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[8192](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[64](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json) / [8](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|n/a|[32000](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[16384](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[2023-08-24](https://huggingface.co/api/models/codellama/CodeLlama-34b-Instruct-hf)|[card](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf) · [config](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|
-   240→|[Qwen/QwQ-32B](https://huggingface.co/Qwen/QwQ-32B)|QwQ|[32.8B](https://huggingface.co/api/models/Qwen/QwQ-32B)|[64](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[5120](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[40](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json) / [8](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[2025-03-05](https://huggingface.co/api/models/Qwen/QwQ-32B)|[card](https://huggingface.co/Qwen/QwQ-32B) · [config](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|
-
-[showing lines 121-240 of 653; use offset=241 with limit to continue reading]

package/tool-results/read_1789888167347_67d1d7c9830a.txt

@@ -1,122 +0,0 @@
-     1→   121→
-     2→   122→## 10. Vision-language/image tokens
-     3→   123→- **Definition:** Image preprocessing converts pixels/patches/tiles into visual tokens or embeddings that consume prefill compute, KV memory, context, and often billable input tokens.
-     4→   124→- **User value:** Avoid severe underestimation of multimodal TTFT, memory, and API cost; support image count, resolution, detail level, frame sampling, and token pruning.
-     5→   125→- **Complexity / priority:** High / Must-have if VLM models are supported.
-     6→   126→- **Quantitative evidence:** Gemini docs allocate 258 tokens for images with both dimensions ≤384 px; larger images are tiled to 768×768, each tile costing 258 tokens, with a crop-unit/tile formula. [Gemini image understanding](https://ai.google.dev/gemini-api/docs/image-understanding)
-     7→   127→- OpenAI's current vision docs specify 32×32 patch tokenization for applicable models: `patch_count = ceil(width/32) × ceil(height/32)`, then model/detail-specific patch budgets/resizing; images count toward input token and TPM limits. [OpenAI images/vision](https://platform.openai.com/docs/guides/images-vision.md)
-     8→   128→- vLLM supports content-hash or stable-ID multimodal caching and video token pruning, useful for local serving formulas. [vLLM multimodal inputs](https://docs.vllm.ai/en/stable/features/multimodal_inputs/)
-     9→   129→- **Formula implications:** `total_prefill_tokens = text_tokens + Σ(image_tokens) + Σ(video_frame_tokens)`; cost = total billable input × input rate; KV memory applies after projected visual tokens enter the language backbone. Add resolution/detail/model-specific tokenizer tables.
-    10→   130→- **Caveats:** Image-token rules are model/provider-specific and changing; don't use one universal “image = N tokens.” Llama/Qwen/Pixtral tokenization must be sourced per model card/processor.
-    11→   131→
-    12→   132→## 11. Training throughput & fine-tuning
-    13→   133→- **Definition:** A training calculator estimates forward/backward FLOPs, optimizer/activation/parameter memory, wall time, and cost for full SFT, LoRA, and QLoRA.
-    14→   134→- **User value:** Users can choose feasible GPUs and compare fine-tuning economics before provisioning.
-    15→   135→- **Complexity / priority:** High / Nice (Future full trainer; adapter estimator sooner).
-    16→   136→- **Quantitative evidence:** Chinchilla's paper trained >400 models spanning 70M–16B parameters and 5B–500B tokens; its compute-optimal finding is to scale model size and training-token count approximately equally under a fixed compute budget. [Chinchilla paper](https://arxiv.org/abs/2203.15556)
-    17→   137→- LoRA reports up to 10,000× fewer trainable parameters and 3× lower GPU memory vs GPT-3 full fine-tuning with Adam in its evaluated setup. [LoRA paper](https://arxiv.org/abs/2106.09685)
-    18→   138→- QLoRA reports fine-tuning a 65B model on one 48GB GPU; its paper describes reducing >780GB average memory for 16-bit fine-tuning to <48GB in the evaluated setup. [QLoRA paper](https://arxiv.org/html/2305.14314v1)
-    19→   139→- **Formula implications:** First approximation for dense decoder training compute is proportional to `6 × parameters × training_tokens`; show as an assumption, then calibrate with measured FLOPs/utilization. LoRA trainable params = sum over adapted matrices `r·(d_in+d_out)`; QLoRA adds quantized frozen weights plus adapter/optimizer/activation memory.
-    20→   140→- **Caveats:** 6ND is an approximation; attention, sequence length, activation checkpointing, optimizer, packing, MoE routing, and communication alter real cost. LoRA ratios are not universal.
-    21→   141→
-    22→   142→## 12. Build-vs-buy calculator
-    23→   143→- **Definition:** Compare self-hosted GPU cost/latency/capacity against API pricing for the same input/output/workload distribution.
-    24→   144→- **User value:** Directly answers whether utilization, latency/SLO, privacy, or operational complexity justifies owning/renting GPUs.
-    25→   145→- **Complexity / priority:** Medium / Must-have.
-    26→   146→- **Formula implications:** Self-host cost/request = `(GPU_hourly_cost × wall_time + CPU/RAM/egress/ops amortization)/requests`; per-million-token cost = hourly_cost / effective_tokens_per_hour × 1e6. API cost = uncached input×input_rate + cached input×cached_rate + output×output_rate + tool/media charges. Break-even volume solves self-host fixed+variable = API variable.
-    27→   147→- **Required knobs:** utilization, concurrency, TTFT/TPOT SLO, prompt/output distributions, cache hit rate, quantization, replicas/HA, region/egress, idle/cold-start time, and API batch discounts.
-    28→   148→- **Caveats:** Prices change quickly and throughput benchmarks are not apples-to-apples; link every provider/model price and timestamp it. No universal demand statistic was verified, but this feature follows directly from the cost equations and existing tokcalc scope.
-    29→   149→
-    30→   150→## 13. Energy / carbon per million tokens
-    31→   151→- **Definition:** Attribute measured/estimated electricity and regional carbon intensity to prefill/decode work, then normalize by tokens.
-    32→   152→- **User value:** Sustainability reporting and energy-aware model/GPU selection; helps expose long-context/reasoning cost not visible in dollars.
-    33→   153→- **Complexity / priority:** Medium–High / Nice.
-    34→   154→- **Quantitative evidence:** A 2025 infrastructure-aware benchmark gives `Carbon (kgCO2e) = E_query × CIF` and separates prompt-level operational footprint; it reports ~1.14 gCO2e per 400-token query for Mistral Large 2 as aligned with Mistral's LCA, but this is workload/region-specific. [Hungry AI paper](https://arxiv.org/html/2505.09598v6) [Mistral LCA reference is linked in paper]
-    35→   155→- CodeCarbon measures/estimates CPU, GPU, and RAM electricity and applies regional carbon intensity. [CodeCarbon](https://github.com/mlco2/codecarbon)
-    36→   156→- **Formula implications:** `E_Wh = ∫ power_W dt / 3600`; `gCO2e = E_Wh × carbon_intensity_g/Wh × PUE`; report `gCO2e / 1e6 output_tokens` and optionally input/output separately. Include facility overhead and region as explicit fields.
-    37→   157→- **Caveats:** API providers rarely publish per-request power; GPU TDP is not measured draw; utilization, batching, PUE, cooling, and grid mix dominate. I found no stable universal gCO2e/M-token constant.
-    38→   158→
-    39→   159→## 14. Serverless GPU cold starts
-    40→   160→- **Definition:** Time from scale-to-zero request to a ready model worker/first token, including container/image pull, library init, weight transfer, CUDA graph capture, and model warmup.
-    41→   161→- **User value:** Quantify tail latency and economics for bursty workloads; compare warm pool, snapshot, quantization, and scale-to-zero strategies.
-    42→   162→- **Complexity / priority:** Medium / Nice.
-    43→   163→- **Quantitative evidence:** Modal says model weights can load from a Volume at 1–2 GB/s, roughly nearly 1 second of cold-start latency per GB of weights; its high-performance guide reports GPU memory snapshots can yield 10x cold-start reductions. [Modal high-performance LLM inference](https://modal.com/docs/guide/high-performance-llm-inference)
-    44→   164→- Modal's Ministral 3 test reports median cold start falling from ~118s to ~12s with GPU snapshotting. [Modal blog](https://modal.com/blog/mistral-3)
-    45→   165→- RunPod's vLLM cold-start guide says uncached image pulls can take 30–90s; official RunPod materials advertise sub-200ms FlashBoot for active endpoints, which should be treated as a warm/snapshot path, not a generic model boot. [RunPod guide](https://www.runpod.io/blog/cut-vllm-cold-starts-runpod-serverless) [RunPod product](https://www.runpod.io/product/serverless)
-    46→   166→- **Formula implications:** `cold_start ≈ image_pull + container_init + weight_load(model_GB / effective_GBps) + GPU_load + compile/capture + warmup`; amortize over requests per warm interval. Add p50/p95/p99, warm-worker fraction, snapshot support, model size, and provider.
-    47→   167→- **Caveats:** Marketing numbers are platform/configuration-specific; exact cold-start distributions for Replicate/RunPod/Modal vary by region, cached image/model, GPU availability, and model. Treat every provider value as timestamped benchmark input, not a constant.
-    48→   168→
-    49→   169→## Cross-cutting implementation schema
-    50→   170→Store per feature/model/provider: source URL, benchmark date, hardware, engine/version, model/quantization, prompt/output distributions, batch/concurrency, QPS, metric (TTFT/TPOT/ITL/throughput/cost/energy), and confidence. Keep measured benchmark multipliers separate from analytical estimates.
-    51→   171→
-    52→   172→## Gaps / failed attempts
-    53→   173→- vLLM docs and vendor pages were readable, but several arXiv abstract pages and older dynamic docs timed out in extraction; equivalent official pages or arXiv results were used where content was available.
-    54→   174→- No authoritative universal chunked-prefill speedup, agent tool-call latency multiplier, long-context 1M throughput multiplier, embedding market-demand figure, or universal energy/token constant was verified.
-    55→   175→- OpenAI's public marketing pricing page returned 403 in direct fetch; the official developer pricing/prompt-caching docs were available and should be used for current model rates.
-    56→   176→
-    57→   177→
-    58→   178→---
-    59→   179→
-    60→   180→# Tokcalc Section B — implementation-ready model catalog
-    61→   181→
-    62→   182→**Cutoff:** 2026-09-20. **Status:** best effort within the declared HF/API universe; not exhaustive of every community checkpoint. Architecture fields are taken from direct config JSON when readable. HF `createdAt` is a repository-date proxy, not necessarily announcement date. `n/a` means not disclosed or inaccessible; it must remain null in the calculator.
-    63→   183→
-    64→   184→## Open LLM, coding, and reasoning rows
-    65→   185→
-    66→   186→|Official HF model|Family|Total / active params|Layers|Hidden|Q / KV heads|Head dim|Vocab|Context|Release/date proxy|Sources|
-    67→   187→|---|---|---:|---:|---:|---:|---:|---:|---:|---|---|
-    68→   188→|[meta-llama/Llama-4-Scout-17B-16E-Instruct](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E-Instruct)|Llama 4|[~109B / 17B](https://huggingface.co/blog/llama4-release)|n/a|n/a|n/a / n/a|n/a|n/a|[10M advertised](https://developer.meta.com/ai/models/llama-4/)|[2025-04-05](https://huggingface.co/api/models/meta-llama/Llama-4-Scout-17B-16E-Instruct)|[card](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E-Instruct) · [config](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E-Instruct/raw/main/config.json)|
-    69→   189→|[meta-llama/Llama-4-Maverick-17B-128E-Instruct](https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct)|Llama 4|[~400B / 17B](https://huggingface.co/blog/llama4-release)|n/a|n/a|n/a / n/a|n/a|n/a|[1M advertised](https://developer.meta.com/ai/models/llama-4/)|[2025-04-05](https://huggingface.co/api/models/meta-llama/Llama-4-Maverick-17B-128E-Instruct)|[card](https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct) · [config](https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct/raw/main/config.json)|
-    70→   190→|[meta-llama/Llama-4-Behemoth-17B-16E-Instruct](https://huggingface.co/meta-llama/Llama-4-Behemoth-17B-16E-Instruct)|Llama 4|[~2T / 288B](https://ai.meta.com/blog/llama-4-multimodal-intelligence)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2025-04-05 announced](https://huggingface.co/api/models/meta-llama/Llama-4-Behemoth-17B-16E-Instruct)|[card](https://huggingface.co/meta-llama/Llama-4-Behemoth-17B-16E-Instruct) · [config](https://huggingface.co/meta-llama/Llama-4-Behemoth-17B-16E-Instruct/raw/main/config.json)|
-    71→   191→|[Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B)|Qwen 3|[0.6B](https://huggingface.co/api/models/Qwen/Qwen3-0.6B)|[28](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[1024](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[16](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-0.6B)|[card](https://huggingface.co/Qwen/Qwen3-0.6B) · [config](https://huggingface.co/Qwen/Qwen3-0.6B/raw/main/config.json)|
-    72→   192→|[Qwen/Qwen3-4B](https://huggingface.co/Qwen/Qwen3-4B)|Qwen 3|[4B](https://huggingface.co/api/models/Qwen/Qwen3-4B)|[36](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[2560](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[32](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-4B)|[card](https://huggingface.co/Qwen/Qwen3-4B) · [config](https://huggingface.co/Qwen/Qwen3-4B/raw/main/config.json)|
-    73→   193→|[Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B)|Qwen 3|[8B](https://huggingface.co/api/models/Qwen/Qwen3-8B)|[36](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[4096](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[32](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-8B)|[card](https://huggingface.co/Qwen/Qwen3-8B) · [config](https://huggingface.co/Qwen/Qwen3-8B/raw/main/config.json)|
-    74→   194→|[Qwen/Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B)|Qwen 3|[14B](https://huggingface.co/api/models/Qwen/Qwen3-14B)|[40](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-14B)|[card](https://huggingface.co/Qwen/Qwen3-14B) · [config](https://huggingface.co/Qwen/Qwen3-14B/raw/main/config.json)|
-    75→   195→|[Qwen/Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B)|Qwen 3|[32B](https://huggingface.co/api/models/Qwen/Qwen3-32B)|[64](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[64](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-32B)|[card](https://huggingface.co/Qwen/Qwen3-32B) · [config](https://huggingface.co/Qwen/Qwen3-32B/raw/main/config.json)|
-    76→   196→|[Qwen/Qwen3-30B-A3B](https://huggingface.co/Qwen/Qwen3-30B-A3B)|Qwen 3|[30B](https://huggingface.co/api/models/Qwen/Qwen3-30B-A3B)|[48](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[2048](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[32](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-30B-A3B)|[card](https://huggingface.co/Qwen/Qwen3-30B-A3B) · [config](https://huggingface.co/Qwen/Qwen3-30B-A3B/raw/main/config.json)|
-    77→   197→|[Qwen/Qwen3-235B-A22B](https://huggingface.co/Qwen/Qwen3-235B-A22B)|Qwen 3|[235B](https://huggingface.co/api/models/Qwen/Qwen3-235B-A22B)|[94](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[4096](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[64](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[128](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[151936](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|[2025-04-27](https://huggingface.co/api/models/Qwen/Qwen3-235B-A22B)|[card](https://huggingface.co/Qwen/Qwen3-235B-A22B) · [config](https://huggingface.co/Qwen/Qwen3-235B-A22B/raw/main/config.json)|
-    78→   198→|[Qwen/Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct)|Qwen 2.5-VL|[7B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-7B-Instruct)|[28](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[3584](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[28](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|[2025-01-26](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-7B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct/raw/main/config.json)|
-    79→   199→|[Qwen/Qwen2.5-VL-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct)|Qwen 2.5-VL|[32B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-32B-Instruct)|[64](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|[2025-03-21](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-32B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-32B-Instruct/raw/main/config.json)|
-    80→   200→|[Qwen/Qwen2.5-VL-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct)|Qwen 2.5-VL|[72B](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-72B-Instruct)|[80](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[8192](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[64](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[128000](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|[2025-01-27](https://huggingface.co/api/models/Qwen/Qwen2.5-VL-72B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/raw/main/config.json)|
-    81→   201→|[Qwen/Qwen2.5-MoE-A2.7B](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B)|Other|[n/a](https://huggingface.co/api/models/Qwen/Qwen2.5-MoE-A2.7B)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|n/a|[card](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B) · [config](https://huggingface.co/Qwen/Qwen2.5-MoE-A2.7B/raw/main/config.json)|
-    82→   202→|[Qwen/Qwen2.5-Coder-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct)|Qwen 2.5 Coder|[7B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-7B-Instruct)|[28](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[3584](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[28](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|[2024-09-17](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-7B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/raw/main/config.json)|
-    83→   203→|[Qwen/Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct)|Qwen 2.5 Coder|[14B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-14B-Instruct)|[48](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|[2024-11-06](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-14B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct/raw/main/config.json)|
-    84→   204→|[Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)|Qwen 2.5 Coder|[32B](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-32B-Instruct)|[64](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[5120](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[40](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json) / [8](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|[2024-11-06](https://huggingface.co/api/models/Qwen/Qwen2.5-Coder-32B-Instruct)|[card](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct) · [config](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/raw/main/config.json)|
-    85→   205→|[deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3)|[61](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|[2024-12-25](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3)|[card](https://huggingface.co/deepseek-ai/DeepSeek-V3) · [config](https://huggingface.co/deepseek-ai/DeepSeek-V3/raw/main/config.json)|
-    86→   206→|[deepseek-ai/DeepSeek-V3-0324](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3-0324)|[61](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|[2025-03-24](https://huggingface.co/api/models/deepseek-ai/DeepSeek-V3-0324)|[card](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324) · [config](https://huggingface.co/deepseek-ai/DeepSeek-V3-0324/raw/main/config.json)|
-    87→   207→|[deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1)|[61](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|[2025-01-20](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1)|[card](https://huggingface.co/deepseek-ai/DeepSeek-R1) · [config](https://huggingface.co/deepseek-ai/DeepSeek-R1/raw/main/config.json)|
-    88→   208→|[deepseek-ai/DeepSeek-R1-0528](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528)|DeepSeek|[671B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1-0528)|[61](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[7168](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|n/a|[129280](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|[2025-05-28](https://huggingface.co/api/models/deepseek-ai/DeepSeek-R1-0528)|[card](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528) · [config](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528/raw/main/config.json)|
-    89→   209→|[deepseek-ai/DeepSeek-Coder-V2-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct)|DeepSeek Coder V2|[236B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Instruct)|[60](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[5120](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[128](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json) / [128](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|n/a|[102400](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|[2024-06-14](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Instruct)|[card](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct) · [config](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/raw/main/config.json)|
-    90→   210→|[mistralai/Mistral-Large-Instruct-2411](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411)|Mistral|[122.6B](https://huggingface.co/api/models/mistralai/Mistral-Large-Instruct-2411)|[88](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[12288](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[96](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json) / [8](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[128](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[131072](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|[2024-11-14](https://huggingface.co/api/models/mistralai/Mistral-Large-Instruct-2411)|[card](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411) · [config](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411/raw/main/config.json)|
-    91→   211→|[mistralai/Codestral-22B-v0.1](https://huggingface.co/mistralai/Codestral-22B-v0.1)|Mistral|[22.2B](https://huggingface.co/api/models/mistralai/Codestral-22B-v0.1)|[56](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[6144](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[48](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json) / [8](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|n/a|[32768](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|[2024-05-29](https://huggingface.co/api/models/mistralai/Codestral-22B-v0.1)|[card](https://huggingface.co/mistralai/Codestral-22B-v0.1) · [config](https://huggingface.co/mistralai/Codestral-22B-v0.1/raw/main/config.json)|
-    92→   212→|[mistralai/Ministral-3B-Instruct-2410](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410)|Mistral|[3B](https://huggingface.co/api/models/mistralai/Ministral-3B-Instruct-2410)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2024-10; repo 401](https://huggingface.co/api/models/mistralai/Ministral-3B-Instruct-2410)|[card](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410) · [config](https://huggingface.co/mistralai/Ministral-3B-Instruct-2410/raw/main/config.json)|
-    93→   213→|[mistralai/Ministral-8B-Instruct-2410](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410)|Mistral|[8.0B](https://huggingface.co/api/models/mistralai/Ministral-8B-Instruct-2410)|[36](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[4096](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[32](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json) / [8](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[128](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[131072](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[32768](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|[2024-10-15](https://huggingface.co/api/models/mistralai/Ministral-8B-Instruct-2410)|[card](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410) · [config](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410/raw/main/config.json)|
-    94→   214→|[mistralai/Pixtral-12B-2409](https://huggingface.co/mistralai/Pixtral-12B-2409)|Pixtral|[12B](https://huggingface.co/api/models/mistralai/Pixtral-12B-2409)|n/a|n/a|n/a / n/a|n/a|n/a|[128K advertised](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|[2024-09](https://huggingface.co/api/models/mistralai/Pixtral-12B-2409)|[card](https://huggingface.co/mistralai/Pixtral-12B-2409) · [config](https://huggingface.co/mistralai/Pixtral-12B-2409/raw/main/config.json)|
-    95→   215→|[google/gemma-3-1b-it](https://huggingface.co/google/gemma-3-1b-it)|Gemma 3|[1B](https://huggingface.co/api/models/google/gemma-3-1b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[32K](https://huggingface.co/google/gemma-3-1b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-1b-it)|[card](https://huggingface.co/google/gemma-3-1b-it) · [config](https://huggingface.co/google/gemma-3-1b-it/raw/main/config.json)|
-    96→   216→|[google/gemma-3-4b-it](https://huggingface.co/google/gemma-3-4b-it)|Gemma 3|[4B](https://huggingface.co/api/models/google/gemma-3-4b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-4b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-4b-it)|[card](https://huggingface.co/google/gemma-3-4b-it) · [config](https://huggingface.co/google/gemma-3-4b-it/raw/main/config.json)|
-    97→   217→|[google/gemma-3-12b-it](https://huggingface.co/google/gemma-3-12b-it)|Gemma 3|[12B](https://huggingface.co/api/models/google/gemma-3-12b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-12b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-12b-it)|[card](https://huggingface.co/google/gemma-3-12b-it) · [config](https://huggingface.co/google/gemma-3-12b-it/raw/main/config.json)|
-    98→   218→|[google/gemma-3-27b-it](https://huggingface.co/google/gemma-3-27b-it)|Gemma 3|[27B](https://huggingface.co/api/models/google/gemma-3-27b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[128K](https://huggingface.co/google/gemma-3-27b-it/raw/main/config.json)|[2025-03](https://huggingface.co/api/models/google/gemma-3-27b-it)|[card](https://huggingface.co/google/gemma-3-27b-it) · [config](https://huggingface.co/google/gemma-3-27b-it/raw/main/config.json)|
-    99→   219→|[google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it)|Gemma 2|[2B](https://huggingface.co/api/models/google/gemma-2-2b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-2b-it/raw/main/config.json)|[2024-07](https://huggingface.co/api/models/google/gemma-2-2b-it)|[card](https://huggingface.co/google/gemma-2-2b-it) · [config](https://huggingface.co/google/gemma-2-2b-it/raw/main/config.json)|
-   100→   220→|[google/gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it)|Gemma 2|[9B](https://huggingface.co/api/models/google/gemma-2-9b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-9b-it/raw/main/config.json)|[2024-06](https://huggingface.co/api/models/google/gemma-2-9b-it)|[card](https://huggingface.co/google/gemma-2-9b-it) · [config](https://huggingface.co/google/gemma-2-9b-it/raw/main/config.json)|
-   101→   221→|[google/gemma-2-27b-it](https://huggingface.co/google/gemma-2-27b-it)|Gemma 2|[27B](https://huggingface.co/api/models/google/gemma-2-27b-it)|n/a|n/a|n/a / n/a|n/a|n/a|[8K](https://huggingface.co/google/gemma-2-27b-it/raw/main/config.json)|[2024-06](https://huggingface.co/api/models/google/gemma-2-27b-it)|[card](https://huggingface.co/google/gemma-2-27b-it) · [config](https://huggingface.co/google/gemma-2-27b-it/raw/main/config.json)|
-   102→   222→|[microsoft/phi-4](https://huggingface.co/microsoft/phi-4)|Phi|[14.7B](https://huggingface.co/api/models/microsoft/phi-4)|[40](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[5120](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[40](https://huggingface.co/microsoft/phi-4/raw/main/config.json) / [10](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|n/a|[100352](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[16384](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|[2024-12-11](https://huggingface.co/api/models/microsoft/phi-4)|[card](https://huggingface.co/microsoft/phi-4) · [config](https://huggingface.co/microsoft/phi-4/raw/main/config.json)|
-   103→   223→|[microsoft/Phi-4-mini-instruct](https://huggingface.co/microsoft/Phi-4-mini-instruct)|Phi|[3.8B](https://huggingface.co/api/models/microsoft/Phi-4-mini-instruct)|[32](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[3072](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[24](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json) / [8](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|n/a|[200064](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|[2025-02-19](https://huggingface.co/api/models/microsoft/Phi-4-mini-instruct)|[card](https://huggingface.co/microsoft/Phi-4-mini-instruct) · [config](https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/config.json)|
-   104→   224→|[microsoft/Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct)|Phi|[3.8B](https://huggingface.co/api/models/microsoft/Phi-3.5-mini-instruct)|[32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[3072](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json) / [32](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|n/a|[32064](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|[2024-08-16](https://huggingface.co/api/models/microsoft/Phi-3.5-mini-instruct)|[card](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) · [config](https://huggingface.co/microsoft/Phi-3.5-mini-instruct/raw/main/config.json)|
-   105→   225→|[microsoft/Phi-3.5-MoE-instruct](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct)|Phi|[41.9B](https://huggingface.co/api/models/microsoft/Phi-3.5-MoE-instruct)|[32](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[4096](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[32](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json) / [8](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|n/a|[32064](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[131072](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|[2024-08-17](https://huggingface.co/api/models/microsoft/Phi-3.5-MoE-instruct)|[card](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct) · [config](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/raw/main/config.json)|
-   106→   226→|[WizardLM/WizardLM-2-8x22B](https://huggingface.co/WizardLM/WizardLM-2-8x22B)|WizardLM|[141B](https://huggingface.co/api/models/WizardLM/WizardLM-2-8x22B)|n/a|n/a|n/a / n/a|n/a|n/a|n/a|[2024-04](https://huggingface.co/api/models/WizardLM/WizardLM-2-8x22B)|[card](https://huggingface.co/WizardLM/WizardLM-2-8x22B) · [config](https://huggingface.co/WizardLM/WizardLM-2-8x22B/raw/main/config.json)|
-   107→   227→|[microsoft/Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b)|Orca|[n/a](https://huggingface.co/api/models/microsoft/Orca-2-13b)|[40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[5120](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json) / [40](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|n/a|[32003](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[4096](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|[2023-11-14](https://huggingface.co/api/models/microsoft/Orca-2-13b)|[card](https://huggingface.co/microsoft/Orca-2-13b) · [config](https://huggingface.co/microsoft/Orca-2-13b/raw/main/config.json)|
-   108→   228→|[microsoft/BitNet-b1.58-2B-4T](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T)|BitNet|[850M](https://huggingface.co/api/models/microsoft/BitNet-b1.58-2B-4T)|[30](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[2560](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[20](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json) / [5](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|n/a|[128256](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[4096](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|[2025-04-15](https://huggingface.co/api/models/microsoft/BitNet-b1.58-2B-4T)|[card](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T) · [config](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T/raw/main/config.json)|
-   109→   229→|[HuggingFaceTB/SmolLM2-135M](https://huggingface.co/HuggingFaceTB/SmolLM2-135M)|SmolLM2|[135M](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-135M)|[30](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[576](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[9](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json) / [3](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|[2024-10-31](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-135M)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-135M) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-135M/raw/main/config.json)|
-   110→   230→|[HuggingFaceTB/SmolLM2-360M](https://huggingface.co/HuggingFaceTB/SmolLM2-360M)|SmolLM2|[362M](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-360M)|[32](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[960](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[15](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json) / [5](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|[2024-10-31](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-360M)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-360M) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-360M/raw/main/config.json)|
-   111→   231→|[HuggingFaceTB/SmolLM2-1.7B](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B)|SmolLM2|[1.7B](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-1.7B)|[24](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[2048](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[32](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json) / [32](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|n/a|[49152](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[8192](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|[2024-10-30](https://huggingface.co/api/models/HuggingFaceTB/SmolLM2-1.7B)|[card](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B) · [config](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B/raw/main/config.json)|
-   112→   232→|[TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|TinyLlama|[1.1B](https://huggingface.co/api/models/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|[22](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2048](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[32](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json) / [4](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|n/a|[32000](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2048](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|[2023-12-30](https://huggingface.co/api/models/TinyLlama/TinyLlama-1.1B-Chat-v1.0)|[card](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) · [config](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0/raw/main/config.json)|
-   113→   233→|[allenai/OLMo-2-1124-7B-Instruct](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct)|OLMo|[7.3B](https://huggingface.co/api/models/allenai/OLMo-2-1124-7B-Instruct)|[32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[4096](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json) / [32](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|n/a|[100352](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[4096](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|[2024-12-18](https://huggingface.co/api/models/allenai/OLMo-2-1124-7B-Instruct)|[card](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct) · [config](https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct/raw/main/config.json)|
-   114→   234→|[tiiuae/Falcon3-7B-Instruct](https://huggingface.co/tiiuae/Falcon3-7B-Instruct)|Falcon 3|[7.5B](https://huggingface.co/api/models/tiiuae/Falcon3-7B-Instruct)|[28](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[3072](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[12](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json) / [4](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[256](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[131072](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[32768](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|[2024-11-29](https://huggingface.co/api/models/tiiuae/Falcon3-7B-Instruct)|[card](https://huggingface.co/tiiuae/Falcon3-7B-Instruct) · [config](https://huggingface.co/tiiuae/Falcon3-7B-Instruct/raw/main/config.json)|
-   115→   235→|[01-ai/Yi-1.5-9B-Chat](https://huggingface.co/01-ai/Yi-1.5-9B-Chat)|Yi 1.5|[8.8B](https://huggingface.co/api/models/01-ai/Yi-1.5-9B-Chat)|[48](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[4096](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[32](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json) / [4](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|n/a|[64000](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[4096](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|[2024-05-10](https://huggingface.co/api/models/01-ai/Yi-1.5-9B-Chat)|[card](https://huggingface.co/01-ai/Yi-1.5-9B-Chat) · [config](https://huggingface.co/01-ai/Yi-1.5-9B-Chat/raw/main/config.json)|
-   116→   236→|[internlm/internlm2_5-7b-chat](https://huggingface.co/internlm/internlm2_5-7b-chat)|InternLM 2.5|[7.7B](https://huggingface.co/api/models/internlm/internlm2_5-7b-chat)|[32](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[4096](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[32](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json) / [8](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|n/a|[92544](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[32768](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|[2024-06-27](https://huggingface.co/api/models/internlm/internlm2_5-7b-chat)|[card](https://huggingface.co/internlm/internlm2_5-7b-chat) · [config](https://huggingface.co/internlm/internlm2_5-7b-chat/raw/main/config.json)|
-   117→   237→|[deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|DeepSeek Coder V2|[16B](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|[27](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[2048](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[16](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json) / [16](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|n/a|[102400](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[163840](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|[2024-06-14](https://huggingface.co/api/models/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)|[card](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct) · [config](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct/raw/main/config.json)|
-   118→   238→|[codellama/CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf)|CodeLlama|[6.7B](https://huggingface.co/api/models/codellama/CodeLlama-7b-hf)|[32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[4096](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json) / [32](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|n/a|[32016](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[16384](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|[2023-08-24](https://huggingface.co/api/models/codellama/CodeLlama-7b-hf)|[card](https://huggingface.co/codellama/CodeLlama-7b-hf) · [config](https://huggingface.co/codellama/CodeLlama-7b-hf/raw/main/config.json)|
-   119→   239→|[codellama/CodeLlama-34b-Instruct-hf](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf)|CodeLlama|[33.7B](https://huggingface.co/api/models/codellama/CodeLlama-34b-Instruct-hf)|[48](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[8192](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[64](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json) / [8](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|n/a|[32000](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[16384](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|[2023-08-24](https://huggingface.co/api/models/codellama/CodeLlama-34b-Instruct-hf)|[card](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf) · [config](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf/raw/main/config.json)|
-   120→   240→|[Qwen/QwQ-32B](https://huggingface.co/Qwen/QwQ-32B)|QwQ|[32.8B](https://huggingface.co/api/models/Qwen/QwQ-32B)|[64](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[5120](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[40](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json) / [8](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|n/a|[152064](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[40960](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|[2025-03-05](https://huggingface.co/api/models/Qwen/QwQ-32B)|[card](https://huggingface.co/Qwen/QwQ-32B) · [config](https://huggingface.co/Qwen/QwQ-32B/raw/main/config.json)|
-   121→
-   122→[showing lines 121-240 of 653; use offset=241 with limit to continue reading]