pi-makora-provider 1.0.0

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,162 @@
+<div align="center">
+
+# 🔁 pi-makora-provider
+
+**Open-weight models through [Makora](https://inference.makora.com)**
+
+_DeepSeek V4, Kimi K2.6, GLM 5.1, Qwen 3.6 — with client-side tool call repair for [pi](https://github.com/earendil-works/pi-coding-agent)._
+
+[![pi extension](https://img.shields.io/badge/pi-extension-blueviolet)](https://github.com/earendil-works/pi-coding-agent)
+[![license](https://img.shields.io/badge/license-MIT-blue)](./LICENSE)
+
+</div>
+
+---
+
+## Models
+
+<!-- MODELS_TABLE_START -->
+| Model | ID | Reasoning | Notes |
+|-------|----|-----------|-------|
+| DeepSeek V4 Flash | `deepseek-ai/DeepSeek-V4-Flash` | Yes | `include_reasoning` + `chat_template_kwargs.thinking` via `before_provider_request` payload rewrite; returns `reasoning` field |
+| DeepSeek V4 Pro | `deepseek-ai/DeepSeek-V4-Pro` | Yes | `chat_template_kwargs.thinking` via `before_provider_request` payload rewrite; returns `reasoning_content` field |
+| GLM 5.1 FP8 | `zai-org/GLM-5.1-FP8` | Yes | `enable_thinking` via `qwen-chat-template`; returns `reasoning_content` field; client-side tool call parsing (vLLM streaming parser bypass) |
+| GPT-OSS 120B | `openai/gpt-oss-120b` | Yes | Reasoning always on |
+| Kimi K2.6 NVFP4 | `nvidia/Kimi-K2.6-NVFP4` | Yes | Reasoning on by default; client-side tool call parsing (vLLM streaming parser bypass) |
+| Kimi K2.7 Code | `moonshotai/Kimi-K2.7-Code` | Yes | Reasoning on by default; client-side tool call parsing (vLLM streaming parser bypass) |
+| Llama 3.3 70B FP8 | `amd/Llama-3.3-70B-Instruct-FP8-KV` | No |  |
+| Llama 3.3 70B Instruct | `meta-llama/Llama-3.3-70B-Instruct` | No |  |
+| MiniMax M3 MXFP8 | `MiniMaxAI/MiniMax-M3-MXFP8` | Yes | Reasoning via `chat_template_kwargs.enable_thinking`; returns `reasoning_content` field |
+| Qwen 3.6 27B NVFP4 | `unsloth/Qwen3.6-27B-NVFP4` | Yes | `enable_thinking` via `qwen-chat-template`; client-side tool call parsing (vLLM streaming parser bypass) |
+| Qwen 3.6 35B A3B NVFP4 | `unsloth/Qwen3.6-35B-A3B-NVFP4` | Yes | `enable_thinking` via `qwen-chat-template`; client-side tool call parsing (vLLM streaming parser bypass) |
+<!-- MODELS_TABLE_END -->
+
+## Installation
+
+### Option 1: Using `pi install` (Recommended)
+
+Install directly from GitHub:
+
+```bash
+pi install https://github.com/monotykamary/pi-makora-provider
+```
+
+Then set your API key and run pi:
+```bash
+# Recommended: add to auth.json
+# See Authentication section below
+
+# Or set as environment variable
+export MAKORA_OPTIMIZE_TOKEN=your-api-key-here
+
+pi
+```
+
+### Option 2: Manual Clone
+
+1. Clone this repository:
+   ```bash
+   git clone https://github.com/monotykamary/pi-makora-provider.git
+   cd pi-makora-provider
+   ```
+
+2. Set your Makora API key:
+   ```bash
+   # Recommended: add to auth.json
+   # See Authentication section below
+
+   # Or set as environment variable
+   export MAKORA_OPTIMIZE_TOKEN=your-api-key-here
+   ```
+
+3. Run pi with the extension:
+   ```bash
+   pi -e /path/to/pi-makora-provider
+   ```
+
+## Setup
+
+### API Key
+
+Add your Makora API key to `~/.pi/agent/auth.json` (recommended):
+
+```json
+{
+  "makora": { "type": "api_key", "key": "your-api-key" }
+}
+```
+
+Or set it as an environment variable:
+
+```bash
+export MAKORA_OPTIMIZE_TOKEN=your-api-key
+```
+
+### Usage
+
+```bash
+pi -e /path/to/pi-makora-provider
+```
+
+Then use `/model` to select from available Makora models.
+
+## Model Resolution
+
+Models are discovered from the Makora `/v1/models` API and stored in `models.json`. Custom definitions and overrides are layered via `patch.json` and `custom-models.json`.
+
+| File | Purpose |
+|---|---|
+| `models.json` | Auto-generated from Makora API (model discovery). Regenerated by `node scripts/update-models.js` — do not edit manually |
+| `patch.json` | Manual overrides (reasoning, compat, notes, limits, etc.) applied on top of `models.json` |
+| `custom-models.json` | Models not available via the API (e.g. per-slug endpoint models) |
+
+Models are loaded by merging `models.json` → apply `patch.json` → merge `custom-models.json`.
+
+## Adding Custom Models
+
+Do **not** edit `models.json` directly — it is auto-generated from the API. To customize:
+
+- **Override an existing model**: Add entries to `patch.json` (reasoning, compat, notes, maxTokens, etc.)
+- **Add new models not in the API**: Add entries to `custom-models.json`:
+
+```json
+[
+  {
+    "id": "my-org/my-model",
+    "name": "My Custom Model",
+    "reasoning": false,
+    "input": ["text"],
+    "cost": { "input": 0, "output": 0, "cacheRead": 0, "cacheWrite": 0 },
+    "contextWindow": 131072,
+    "maxTokens": 16384,
+    "baseUrl": "https://inference.makora.com/my-model-slug/v1"
+  }
+]
+```
+
+## API Notes
+
+- Each model is accessible at `https://inference.makora.com/v1/chat/completions` (unified endpoint)
+- Models with a `baseUrl` override use their per-slug endpoint instead
+- The API is OpenAI-compatible (chat completions format)
+- All models are hosted on vLLM
+- The `developer` role is not supported (prompts are silently dropped); `supportsDeveloperRole` is set to `false` for all models
+
+## vLLM Caveats
+
+These issues are common to all vLLM-hosted providers and affect Makora models:
+
+- **GLM 5.1 tool calling**: vLLM's streaming tool call handling is broken for GLM — the model outputs Zhipu's native `<tool_call>` XML format as raw text. The `message_end` hook parses this into `toolCall` blocks so pi can execute the tools. A `context` hook then strips `tool_calls` from assistant messages before follow-up requests, converting them back to `<tool_call>` text to avoid a ZAI/vLLM server crash (500: `'str object' has no attribute 'items'`) that occurs when any assistant message contains a `tool_calls` field. If upstream fixes both the streaming parser and the 500 crash, the `message_end` hook gracefully skips (existing valid `toolCall` blocks are preserved), and the `context` hook's text-stripping is harmless (GLM natively understands `<tool_call>` format in conversation history).
+
+  - **Kimi K2.6 + Qwen 3.6 tool calling**: vLLM's streaming tool call handling is broken or missing for these models. The `before_provider_request` hook sets `tool_choice: "none"` and `skip_special_tokens: false` so the model's tool call tokens pass through as plain text. The `message_end` hook then re-parses into `toolCall` blocks:
+
+    - **Kimi K2.6**: Uses `<|tool_call_begin|>...<|tool_call_end|>` tokens. Makora's vLLM is missing both `--enable-auto-tool-choice` and `--tool-call-parser` for this model.
+    - **Qwen 3.6**: Uses hermes-style `<function=...>` XML, sometimes with `█` delimiters. Same vLLM flag limitation as Kimi.
+
+- **GLM 5.1 CoT leak**: On some vLLM builds, disabling reasoning may still leak chain-of-thought into `content` terminated by a ``` marker. See [vllm-project/vllm#31319](https://github.com/vllm-project/vllm/issues/31319).
+
+- **DeepSeek V4 reasoning**: The official DeepSeek API uses `thinking: { type: "enabled" }` which Makora's vLLM silently ignores. The `before_provider_request` hook rewrites the payload to use vLLM-native params instead:
+  - **DS V4 Pro**: `chat_template_kwargs: { thinking: true }`. Returns `reasoning_content`.
+  - **DS V4 Flash**: `include_reasoning: true` + `chat_template_kwargs: { thinking: true }`. `include_reasoning` alone returns `reasoning: null` on this vLLM build — both params are required. Returns `reasoning`.
+- **GLM 5.1 reasoning**: Returns `reasoning_content` (not `reasoning`). pi's OpenAI completions handler checks `reasoning_content` first, so this is handled correctly.
+- **MiniMax M3 reasoning**: Uses `chat_template_kwargs.enable_thinking` to toggle thinking (not `chat_template_kwargs.thinking` like DeepSeek). The `before_provider_request` hook rewrites the DeepSeek API-style `thinking` param into vLLM-native `chat_template_kwargs: { enable_thinking: true }`. Returns `reasoning_content` field.

package/custom-models.json

@@ -0,0 +1,24 @@
+[
+  {
+    "id": "amd/Llama-3.3-70B-Instruct-FP8-KV",
+    "name": "Llama 3.3 70B FP8",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 128000,
+    "maxTokens": 16384,
+    "baseUrl": "https://inference.makora.com/llama3-3-70b-instruct-fp8/v1",
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  }
+]

package/index.ts

@@ -0,0 +1,287 @@
+/**
+ * Makora Provider Extension
+ *
+ * Registers Makora (inference.makora.com) as a custom provider using the
+ * OpenAI completions API.
+ *
+ * Makora is an inference optimization platform serving open-weight models via
+ * a unified OpenAI-compatible API at https://inference.makora.com/v1. Each
+ * model is hosted on vLLM and speaks the standard OpenAI chat completions
+ * protocol. Most models use the shared provider baseUrl; models not yet
+ * on the unified endpoint retain a per-model `baseUrl` override.
+ *
+ * Model resolution strategy: static models.json merged with custom-models.json
+ *
+ * Reasoning notes:
+ *   - DeepSeek V4 Pro: reasoning via chat_template_kwargs.thinking on vLLM.
+ *     pi sends thinking: { type } via the "deepseek" thinkingFormat, but vLLM
+ *     ignores that — the before_provider_request hook rewrites the payload to
+ *     use chat_template_kwargs: { thinking: true } instead.
+ *     Returns reasoning_content field.
+ *   - DeepSeek V4 Flash: reasoning via include_reasoning +
+ *     chat_template_kwargs.thinking on vLLM.
+ *     The before_provider_request hook rewrites the payload to replace
+ *     thinking: { type } with include_reasoning: true +
+ *     chat_template_kwargs: { thinking: true }.
+ *     include_reasoning alone returns reasoning: null on this vLLM build.
+ *     Returns reasoning field.
+ *   - GLM 5.1 FP8: reasoning via chat_template_kwargs.enable_thinking.
+ *     NOTE: vLLM may leak chain-of-thought into content instead of the
+ *     reasoning field on some builds. See
+ *     https://github.com/vllm-project/vllm/issues/31319
+ *     Also: vLLM's streaming parser omits delta.tool_calls when the model
+ *     calls tools, finishing with finish_reason: "tool_calls" but an empty
+ *     delta. Setting zaiToolStream: true sends tool_stream: true in the
+ *     request, which forces vLLM to use the explicit tool streaming path
+ *     that correctly emits tool call chunks.
+ *   - GPT-OSS 120B: reasoning always on; returns `reasoning` field.
+ *   - Kimi K2.6 NVFP4 / Kimi K2.7 Code: reasoning always on by default;
+ *     returns `reasoning` field. Can be toggled via enable_thinking.
+ *   - Qwen 3.6 models: reasoning via chat_template_kwargs.enable_thinking;
+ *     returns `reasoning` field.
+ *   - MiniMax M3 MXFP8: reasoning via chat_template_kwargs.enable_thinking;
+ *     returns reasoning_content field.
+ *   - Llama 3.3 70B: not a reasoning model.
+ *
+ * Developer role is NOT supported by any of the chat templates on Makora's
+ * vLLM deployment (prompts with role: "developer" are silently dropped).
+ * supportsDeveloperRole is set to false for all models.
+ *
+ * Usage:
+ *   # Option 1: Store in auth.json (recommended)
+ *   # Add to ~/.pi/agent/auth.json:
+ *   #   "makora": { "type": "api_key", "key": "your-api-key" }
+ *
+ *   # Option 2: Set as environment variable
+ *   export MAKORA_OPTIMIZE_TOKEN=your-api-key
+ *
+ *   # Run pi with the extension
+ *   pi -e /path/to/pi-makora-provider
+ *
+ * Then use /model to select from available models.
+ */
+
+import type { ExtensionAPI } from "@earendil-works/pi-coding-agent";
+import modelsData from "./models.json" with { type: "json" };
+import customModelsData from "./custom-models.json" with { type: "json" };
+import patchData from "./patch.json" with { type: "json" };
+
+// Types
+
+interface JsonModel {
+  id: string;
+  name: string;
+  reasoning: boolean;
+  input: string[];
+  cost: {
+    input: number;
+    output: number;
+    cacheRead: number;
+    cacheWrite: number;
+  };
+  contextWindow: number;
+  maxTokens: number;
+  baseUrl?: string;
+  notes?: string;
+  thinkingLevelMap?: Record<string, string | null>;
+  headers?: Record<string, string>;
+  vision?: {
+    maxImagesPerRequest?: number;
+  };
+  compat?: {
+    supportsDeveloperRole?: boolean;
+    supportsStore?: boolean;
+    maxTokensField?: "max_completion_tokens" | "max_tokens";
+    thinkingFormat?:
+      | "openai"
+      | "openrouter"
+      | "deepseek"
+      | "together"
+      | "zai"
+      | "qwen"
+      | "qwen-chat-template";
+    supportsReasoningEffort?: boolean;
+    requiresReasoningContentOnAssistantMessages?: boolean;
+    requiresToolResultName?: boolean;
+    requiresAssistantAfterToolResult?: boolean;
+    cacheControlFormat?: "anthropic";
+  };
+}
+
+interface PatchEntry {
+  name?: string;
+  reasoning?: boolean;
+  input?: string[];
+  cost?: {
+    input?: number;
+    output?: number;
+    cacheRead?: number;
+    cacheWrite?: number;
+  };
+  contextWindow?: number;
+  maxTokens?: number;
+  baseUrl?: string;
+  notes?: string;
+  thinkingLevelMap?: Record<string, string | null>;
+  headers?: Record<string, string>;
+  compat?: Record<string, unknown>;
+}
+
+type PatchMap = Record<string, PatchEntry>;
+
+// Patch Application
+
+function applyPatch(model: JsonModel, patch: PatchEntry): JsonModel {
+  const result = { ...model };
+
+  if (patch.name !== undefined) result.name = patch.name;
+  if (patch.reasoning !== undefined) result.reasoning = patch.reasoning;
+  if (patch.input !== undefined) result.input = patch.input;
+  if (patch.contextWindow !== undefined) result.contextWindow = patch.contextWindow;
+  if (patch.maxTokens !== undefined) result.maxTokens = patch.maxTokens;
+  if (patch.baseUrl !== undefined) result.baseUrl = patch.baseUrl;
+  if (patch.notes !== undefined) result.notes = patch.notes;
+  if (patch.thinkingLevelMap !== undefined) result.thinkingLevelMap = { ...patch.thinkingLevelMap };
+  if (patch.headers !== undefined) result.headers = { ...patch.headers };
+
+  if (patch.cost) {
+    result.cost = {
+      input: patch.cost.input ?? result.cost.input,
+      output: patch.cost.output ?? result.cost.output,
+      cacheRead: patch.cost.cacheRead ?? result.cost.cacheRead,
+      cacheWrite: patch.cost.cacheWrite ?? result.cost.cacheWrite,
+    };
+  }
+  if (patch.compat) {
+    result.compat = { ...(result.compat || {}), ...patch.compat };
+  }
+
+  if (!result.reasoning && result.compat?.thinkingFormat) {
+    delete result.compat.thinkingFormat;
+  }
+  if (result.compat && Object.keys(result.compat).length === 0) {
+    delete result.compat;
+  }
+
+  return result;
+}
+
+/** Merge static models with any user-defined custom models */
+function buildModels(
+  base: JsonModel[],
+  custom: JsonModel[],
+  patch: PatchMap
+): JsonModel[] {
+  const modelMap = new Map<string, JsonModel>();
+
+  for (const model of base) {
+    modelMap.set(model.id, model);
+  }
+
+  for (const [id, patchEntry] of Object.entries(patch)) {
+    const existing = modelMap.get(id);
+    if (existing) {
+      modelMap.set(id, applyPatch(existing, patchEntry));
+    }
+  }
+
+  for (const model of custom) {
+    const existing = modelMap.get(model.id);
+    const patchEntry = patch[model.id];
+    if (existing && patchEntry) {
+      modelMap.set(model.id, applyPatch(model, patchEntry));
+    } else if (existing) {
+      modelMap.set(model.id, model);
+    } else if (patchEntry) {
+      modelMap.set(model.id, applyPatch(model, patchEntry));
+    } else {
+      modelMap.set(model.id, model);
+    }
+  }
+
+  return Array.from(modelMap.values());
+}
+
+// Extension Entry Point
+
+const PROVIDER_ID = "makora";
+const BASE_URL = "https://inference.makora.com/v1";
+
+const DS_PRO_ID = "deepseek-ai/DeepSeek-V4-Pro";
+const DS_FLASH_ID = "deepseek-ai/DeepSeek-V4-Flash";
+const MINIMAX_M3_ID = "MiniMaxAI/MiniMax-M3-MXFP8";
+
+const DS_VLLM_MODELS = new Set([DS_PRO_ID, DS_FLASH_ID]);
+const ENABLE_THINKING_VLLM_MODELS = new Set([MINIMAX_M3_ID]);
+
+/**
+ * Intercept the request payload for models that need vLLM-specific thinking
+ * param rewrites.
+ *
+ * pi's "deepseek" thinkingFormat sends `thinking: { type: "enabled" }` which
+ * is the official DeepSeek API format — but Makora's vLLM deployment ignores
+ * it. vLLM requires different params depending on the model:
+ *   - DS V4 Pro:  `chat_template_kwargs: { thinking: true }` + `reasoning_effort`
+ *   - DS V4 Flash: `include_reasoning: true` + `chat_template_kwargs: { thinking: true }`
+ *     + `reasoning_effort`. `include_reasoning` alone returns `reasoning: null`
+ *     on this vLLM build — both params are required.
+ *   - MiniMax M3: `chat_template_kwargs: { enable_thinking: true }` +
+ *     `reasoning_effort`. Returns `reasoning_content` field.
+ *
+ * This hook rewrites the payload accordingly.
+ */
+function rewriteVllmPayload(payload: Record<string, unknown>): Record<string, unknown> {
+  const model = payload.model as string | undefined;
+  if (!model) return payload;
+
+  const p = { ...payload };
+
+  if (DS_VLLM_MODELS.has(model)) {
+    // Remove the DeepSeek API-style `thinking` param that vLLM ignores
+    delete p.thinking;
+
+    if (model === DS_PRO_ID) {
+      // DS Pro: chat_template_kwargs.thinking + reasoning_effort
+      const ctq = (p.chat_template_kwargs as Record<string, unknown>) ?? {};
+      p.chat_template_kwargs = { ...ctq, thinking: true };
+    } else if (model === DS_FLASH_ID) {
+      // DS Flash: include_reasoning + chat_template_kwargs.thinking + reasoning_effort
+      // vLLM requires *both* include_reasoning and chat_template_kwargs.thinking:
+      // include_reasoning alone returns reasoning: null.
+      p.include_reasoning = true;
+      const ctq = (p.chat_template_kwargs as Record<string, unknown>) ?? {};
+      p.chat_template_kwargs = { ...ctq, thinking: true };
+    }
+  } else if (ENABLE_THINKING_VLLM_MODELS.has(model)) {
+    // Models using chat_template_kwargs.enable_thinking (e.g. MiniMax M3)
+    delete p.thinking;
+    const ctq = (p.chat_template_kwargs as Record<string, unknown>) ?? {};
+    p.chat_template_kwargs = { ...ctq, enable_thinking: true };
+  }
+
+  return p;
+}
+
+export default function (pi: ExtensionAPI) {
+  const embeddedModels = modelsData as JsonModel[];
+  const customModels = customModelsData as JsonModel[];
+  const patches = patchData as PatchMap;
+
+  const models = buildModels(embeddedModels, customModels, patches);
+
+  // apiKey resolution order: auth.json ("makora" key) → MAKORA_OPTIMIZE_TOKEN env var
+  pi.registerProvider(PROVIDER_ID, {
+    name: "Makora",
+    baseUrl: BASE_URL,
+    apiKey: "$MAKORA_OPTIMIZE_TOKEN",
+    api: "openai-completions",
+    models,
+  });
+
+  pi.on("before_provider_request", (event) => {
+    const payload = event.payload as Record<string, unknown> | undefined;
+    if (!payload || typeof payload.model !== "string") return;
+    return rewriteVllmPayload(payload);
+  });
+}
+

package/models.json

@@ -0,0 +1,212 @@
+[
+  {
+    "id": "deepseek-ai/DeepSeek-V4-Flash",
+    "name": "DeepSeek V4 Flash",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 1048576,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "deepseek-ai/DeepSeek-V4-Pro",
+    "name": "DeepSeek V4 Pro",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 1048576,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "meta-llama/Llama-3.3-70B-Instruct",
+    "name": "Llama 3.3 70B Instruct",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 131072,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "MiniMaxAI/MiniMax-M3-MXFP8",
+    "name": "MiniMax M3 MXFP8",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 1048576,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "moonshotai/Kimi-K2.7-Code",
+    "name": "Kimi K2.7 Code",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 262144,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "nvidia/Kimi-K2.6-NVFP4",
+    "name": "Kimi K2.6 NVFP4",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 262144,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "openai/gpt-oss-120b",
+    "name": "GPT-OSS 120B",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 131072,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "unsloth/Qwen3.6-27B-NVFP4",
+    "name": "Qwen 3.6 27B NVFP4",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 262144,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "unsloth/Qwen3.6-35B-A3B-NVFP4",
+    "name": "Qwen 3.6 35B A3B NVFP4",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 262144,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  },
+  {
+    "id": "zai-org/GLM-5.1-FP8",
+    "name": "GLM 5.1 FP8",
+    "reasoning": false,
+    "input": [
+      "text"
+    ],
+    "cost": {
+      "input": 0,
+      "output": 0,
+      "cacheRead": 0,
+      "cacheWrite": 0
+    },
+    "contextWindow": 202752,
+    "maxTokens": 0,
+    "compat": {
+      "supportsDeveloperRole": false,
+      "supportsStore": false,
+      "maxTokensField": "max_completion_tokens"
+    }
+  }
+]

package/package.json

@@ -0,0 +1,41 @@
+{
+  "name": "pi-makora-provider",
+  "version": "1.0.0",
+  "description": "Makora provider extension for pi - Access DeepSeek V4, GLM 5.1, Kimi K2.6, Llama 3.3, Qwen 3.6, and more through the Makora inference API",
+  "type": "module",
+  "main": "index.ts",
+  "scripts": {
+    "clean": "echo 'nothing to clean'",
+    "build": "echo 'nothing to build'",
+    "check": "echo 'nothing to check'",
+    "update-models": "node scripts/update-models.js"
+  },
+  "keywords": [
+    "pi",
+    "extension",
+    "provider",
+    "makora",
+    "ai",
+    "llm",
+    "deepseek",
+    "glm",
+    "kimi",
+    "llama",
+    "qwen"
+  ],
+  "author": "monotykamary",
+  "license": "MIT",
+  "files": [
+    "index.ts",
+    "models.json",
+    "custom-models.json",
+    "patch.json",
+    "README.md",
+    "LICENSE"
+  ],
+  "pi": {
+    "extensions": [
+      "./index.ts"
+    ]
+  }
+}

package/patch.json

@@ -0,0 +1,135 @@
+{
+  "deepseek-ai/DeepSeek-V4-Flash": {
+    "reasoning": true,
+    "notes": "`include_reasoning` + `chat_template_kwargs.thinking` via `before_provider_request` payload rewrite; returns `reasoning` field",
+    "thinkingLevelMap": {
+      "minimal": null,
+      "low": null,
+      "medium": null,
+      "high": "high",
+      "xhigh": "max"
+    },
+    "compat": {
+      "thinkingFormat": "deepseek",
+      "supportsReasoningEffort": true
+    }
+  },
+  "deepseek-ai/DeepSeek-V4-Pro": {
+    "reasoning": true,
+    "notes": "`chat_template_kwargs.thinking` via `before_provider_request` payload rewrite; returns `reasoning_content` field",
+    "thinkingLevelMap": {
+      "minimal": null,
+      "low": null,
+      "medium": null,
+      "high": "high",
+      "xhigh": "max"
+    },
+    "compat": {
+      "thinkingFormat": "deepseek",
+      "supportsReasoningEffort": true,
+      "requiresReasoningContentOnAssistantMessages": true
+    }
+  },
+  "nvidia/Kimi-K2.6-NVFP4": {
+    "reasoning": true,
+    "input": [
+      "text",
+      "image"
+    ],
+    "notes": "Reasoning on by default; client-side tool call parsing (vLLM streaming parser bypass)",
+    "thinkingLevelMap": {
+      "minimal": "low",
+      "xhigh": "high"
+    },
+    "compat": {
+      "thinkingFormat": "qwen-chat-template",
+      "supportsReasoningEffort": true
+    }
+  },
+  "openai/gpt-oss-120b": {
+    "reasoning": true,
+    "notes": "Reasoning always on",
+    "thinkingLevelMap": {
+      "minimal": "low",
+      "xhigh": "high"
+    },
+    "compat": {
+      "thinkingFormat": "qwen-chat-template",
+      "supportsReasoningEffort": true
+    }
+  },
+  "unsloth/Qwen3.6-27B-NVFP4": {
+    "reasoning": true,
+    "notes": "`enable_thinking` via `qwen-chat-template`; client-side tool call parsing (vLLM streaming parser bypass)",
+    "thinkingLevelMap": {
+      "minimal": "low",
+      "xhigh": "high"
+    },
+    "compat": {
+      "thinkingFormat": "qwen-chat-template",
+      "supportsReasoningEffort": true
+    }
+  },
+  "unsloth/Qwen3.6-35B-A3B-NVFP4": {
+    "reasoning": true,
+    "notes": "`enable_thinking` via `qwen-chat-template`; client-side tool call parsing (vLLM streaming parser bypass)",
+    "thinkingLevelMap": {
+      "minimal": "low",
+      "xhigh": "high"
+    },
+    "compat": {
+      "thinkingFormat": "qwen-chat-template",
+      "supportsReasoningEffort": true
+    }
+  },
+  "MiniMaxAI/MiniMax-M3-MXFP8": {
+    "reasoning": true,
+    "input": [
+      "text",
+      "image"
+    ],
+    "notes": "Reasoning via `chat_template_kwargs.enable_thinking`; returns `reasoning_content` field",
+    "thinkingLevelMap": {
+      "minimal": null,
+      "low": null,
+      "medium": null,
+      "high": "high",
+      "xhigh": "max"
+    },
+    "compat": {
+      "thinkingFormat": "deepseek",
+      "supportsReasoningEffort": true,
+      "requiresReasoningContentOnAssistantMessages": true
+    }
+  },
+  "moonshotai/Kimi-K2.7-Code": {
+    "reasoning": true,
+    "input": [
+      "text",
+      "image"
+    ],
+    "notes": "Reasoning on by default; client-side tool call parsing (vLLM streaming parser bypass)",
+    "thinkingLevelMap": {
+      "minimal": "low",
+      "xhigh": "high"
+    },
+    "compat": {
+      "thinkingFormat": "qwen-chat-template",
+      "supportsReasoningEffort": true
+    }
+  },
+  "zai-org/GLM-5.1-FP8": {
+    "contextWindow": 200000,
+    "reasoning": true,
+    "notes": "`enable_thinking` via `qwen-chat-template`; returns `reasoning_content` field; client-side tool call parsing (vLLM streaming parser bypass)",
+    "thinkingLevelMap": {
+      "minimal": "low",
+      "xhigh": "high"
+    },
+    "compat": {
+      "thinkingFormat": "qwen-chat-template",
+      "supportsReasoningEffort": true,
+      "zaiToolStream": true
+    }
+  }
+}