token-buffet 0.1.1__tar.gz → 0.2.2__tar.gz

token_buffet-0.2.2/PKG-INFO

@@ -0,0 +1,112 @@
+Metadata-Version: 2.4
+Name: token-buffet
+Version: 0.2.2
+Summary: A pure-Python proxy and routing system to bridge CLI-based LLMs to a standard OpenAI-compatible API.
+Author: Jack
+License-Expression: MIT
+Keywords: llm,proxy,router,openai-compatible,cli,claude,codex,grok,ollama
+Classifier: Development Status :: 3 - Alpha
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Programming Language :: Python :: 3
+Classifier: Operating System :: OS Independent
+Classifier: Topic :: Software Development :: Libraries :: Application Frameworks
+Requires-Python: >=3.12
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: psutil; sys_platform == "darwin"
+Requires-Dist: pyte
+Requires-Dist: pywinpty; sys_platform == "win32"
+Requires-Dist: pexpect; sys_platform != "win32"
+Requires-Dist: openai
+Requires-Dist: ai
+Provides-Extra: capture
+Requires-Dist: pyte; extra == "capture"
+Requires-Dist: pywinpty; sys_platform == "win32" and extra == "capture"
+Requires-Dist: pexpect; sys_platform != "win32" and extra == "capture"
+Requires-Dist: openai; extra == "capture"
+Provides-Extra: responses
+Requires-Dist: openai; extra == "responses"
+Provides-Extra: uistream
+Requires-Dist: ai; extra == "uistream"
+Provides-Extra: all
+Requires-Dist: pyte; extra == "all"
+Requires-Dist: pywinpty; sys_platform == "win32" and extra == "all"
+Requires-Dist: pexpect; sys_platform != "win32" and extra == "all"
+Requires-Dist: openai; extra == "all"
+Requires-Dist: ai; extra == "all"
+Dynamic: license-file
+
+# Token Buffet: CLI LLM Proxy Router
+
+Expose your flat-rate CLI subscriptions (Claude, Codex, Grok, agy) as a local OpenAI/Ollama/Anthropic-compatible API. Route requests by semantic tier (`fast`/`medium`/`reasoning`), smart load balance by quota, and power your downstream tools without paying per token.
+
+## Learn the Concept
+
+For an overview of the LLM Wiki pattern and how this fits in, watch:
+
+**[Karpathy LLM Wiki Overview](https://www.youtube.com/watch?v=iXd0t60YmMw)**
+
+*(Note: The video uses Claude Code as the example, but explains the LLM Wiki concepts and patterns well. Token Buffet applies the same pattern to any CLI-based LLM subscription (Claude, Codex, Grok, agy) and powers Obsidian vaults, community plugins, and agent frameworks.)*
+
+This shows how to turn your subscriptions into a local knowledge-synthesis engine for tools like Obsidian, chatbot clients, and AI agents.
+
+## Features
+- **Small runtime:** The proxy, router, and dashboard use Python's standard HTTP server. Extractor capture needs its optional pseudo-terminal dependencies, and the Responses endpoint needs the OpenAI SDK.
+- **Semantic Routing:** Translates generic model requests (`fast`, `medium`, `reasoning`) into specific provider models based on remaining usage quotas.
+- **Smart Load Balancing:** Reads exported CLI quota files and routes requests to the provider with the most remaining quota.
+- **True Parallelism:** Spawns sandbox directories to bypass SQLite locking limits in native CLIs.
+
+## Architecture
+
+![AI Subscriptions Hub Architecture](res/AI_Subscription_Architecture_landscape.png)
+
+## Quick Start
+Token Buffet always works in the folder you run it from. Make one folder for it:
+
+```bash
+mkdir TokenBuffet && cd TokenBuffet
+pip install token-buffet               # Python 3.12+; installs everything it needs
+tbuffet init                           # scaffold, register the provider CLIs found on PATH, check app integrations
+tbuffet demo init                      # optional: copy the demos, add them to their apps, list which can run
+tbuffet start                          # proxies + router (8090) + dashboard (8080); Ctrl+C stops this session's process trees
+tbuffet start --background             # explicitly leave services running in the background
+tbuffet status | stop | restart | doctor
+```
+Log in to each vendor CLI (`claude`, `codex`, `grok`, `agy`) once. `init` doesn't check logins; a provider that isn't signed in reports its error at `tbuffet start`.
+
+### Demos (pre-configured)
+`tbuffet demo init` copies ready-to-use demos into `demo/`. Each one already points at the router, so after `tbuffet start`:
+- **Obsidian LLM Wiki** (needs Obsidian installed): run `tbuffet open obsidian conference-notes` (or `daily-notes`), then choose *Trust author and enable plugins*. See [the demo README](src/tokenbuffet/default_templates/demo/Obsidian-LLM-Wiki/README.md).
+- **Chatbots and Claudia:** see `demo/README.md`.
+
+### Providers and your own apps
+```bash
+tbuffet add-provider claude --validate        # register a built-in provider + login/quota check
+tbuffet add-provider mine --from config.json  # import a config authored with the register-provider skill
+tbuffet list-providers | remove-provider NAME
+tbuffet add-app obsidian my-vault --path "/path/to/vault" --vault-type daily-notes
+tbuffet list-apps | reconfigure-app TYPE NAME
+```
+
+## Directory Structure
+- `src/tokenbuffet/`: proxy, router, dashboard and launcher
+- `src/tokenbuffet/extractors/`: provider usage and model capture/parse engine
+- `src/tokenbuffet/default_templates/`: what `tbuffet init` copies into your folder:
+  - `config/`
+  - `integrations/` (built-in app types, and `providers/` with the built-in provider configs)
+  - `scripts/`
+  - `demo/` and the demo registrations in `registered_apps/` are copied by `tbuffet demo init`
+
+In your Token Buffet folder:
+- `integrations/providers/`: built-in provider configs (what Token Buffet supports)
+- `registered_providers/`: the providers registered on this machine
+- `data/`: runtime state (`providers_status/`, `provider_homes/`, `temp/`)
+- `logs/`: proxy, router and extractor logs
+
+## From a repository checkout
+Install editable with `pip install -e .`, then run `tbuffet init` and `tbuffet start` from the repository root.
+
+`tbuffet start` launches every provider proxy, the router (port 8090) and the dashboard (port 8080); `tbuffet stop` stops them. `tbuffet dashboard` starts the dashboard alone.
+
+The router listens on port 8090, and the dashboard is at `http://127.0.0.1:8080/`. See the [documentation index](docs/README.md) for the bridge guides.

token_buffet-0.2.2/README.md

@@ -0,0 +1,73 @@
+# Token Buffet: CLI LLM Proxy Router
+
+Expose your flat-rate CLI subscriptions (Claude, Codex, Grok, agy) as a local OpenAI/Ollama/Anthropic-compatible API. Route requests by semantic tier (`fast`/`medium`/`reasoning`), smart load balance by quota, and power your downstream tools without paying per token.
+
+## Learn the Concept
+
+For an overview of the LLM Wiki pattern and how this fits in, watch:
+
+**[Karpathy LLM Wiki Overview](https://www.youtube.com/watch?v=iXd0t60YmMw)**
+
+*(Note: The video uses Claude Code as the example, but explains the LLM Wiki concepts and patterns well. Token Buffet applies the same pattern to any CLI-based LLM subscription (Claude, Codex, Grok, agy) and powers Obsidian vaults, community plugins, and agent frameworks.)*
+
+This shows how to turn your subscriptions into a local knowledge-synthesis engine for tools like Obsidian, chatbot clients, and AI agents.
+
+## Features
+- **Small runtime:** The proxy, router, and dashboard use Python's standard HTTP server. Extractor capture needs its optional pseudo-terminal dependencies, and the Responses endpoint needs the OpenAI SDK.
+- **Semantic Routing:** Translates generic model requests (`fast`, `medium`, `reasoning`) into specific provider models based on remaining usage quotas.
+- **Smart Load Balancing:** Reads exported CLI quota files and routes requests to the provider with the most remaining quota.
+- **True Parallelism:** Spawns sandbox directories to bypass SQLite locking limits in native CLIs.
+
+## Architecture
+
+![AI Subscriptions Hub Architecture](res/AI_Subscription_Architecture_landscape.png)
+
+## Quick Start
+Token Buffet always works in the folder you run it from. Make one folder for it:
+
+```bash
+mkdir TokenBuffet && cd TokenBuffet
+pip install token-buffet               # Python 3.12+; installs everything it needs
+tbuffet init                           # scaffold, register the provider CLIs found on PATH, check app integrations
+tbuffet demo init                      # optional: copy the demos, add them to their apps, list which can run
+tbuffet start                          # proxies + router (8090) + dashboard (8080); Ctrl+C stops this session's process trees
+tbuffet start --background             # explicitly leave services running in the background
+tbuffet status | stop | restart | doctor
+```
+Log in to each vendor CLI (`claude`, `codex`, `grok`, `agy`) once. `init` doesn't check logins; a provider that isn't signed in reports its error at `tbuffet start`.
+
+### Demos (pre-configured)
+`tbuffet demo init` copies ready-to-use demos into `demo/`. Each one already points at the router, so after `tbuffet start`:
+- **Obsidian LLM Wiki** (needs Obsidian installed): run `tbuffet open obsidian conference-notes` (or `daily-notes`), then choose *Trust author and enable plugins*. See [the demo README](src/tokenbuffet/default_templates/demo/Obsidian-LLM-Wiki/README.md).
+- **Chatbots and Claudia:** see `demo/README.md`.
+
+### Providers and your own apps
+```bash
+tbuffet add-provider claude --validate        # register a built-in provider + login/quota check
+tbuffet add-provider mine --from config.json  # import a config authored with the register-provider skill
+tbuffet list-providers | remove-provider NAME
+tbuffet add-app obsidian my-vault --path "/path/to/vault" --vault-type daily-notes
+tbuffet list-apps | reconfigure-app TYPE NAME
+```
+
+## Directory Structure
+- `src/tokenbuffet/`: proxy, router, dashboard and launcher
+- `src/tokenbuffet/extractors/`: provider usage and model capture/parse engine
+- `src/tokenbuffet/default_templates/`: what `tbuffet init` copies into your folder:
+  - `config/`
+  - `integrations/` (built-in app types, and `providers/` with the built-in provider configs)
+  - `scripts/`
+  - `demo/` and the demo registrations in `registered_apps/` are copied by `tbuffet demo init`
+
+In your Token Buffet folder:
+- `integrations/providers/`: built-in provider configs (what Token Buffet supports)
+- `registered_providers/`: the providers registered on this machine
+- `data/`: runtime state (`providers_status/`, `provider_homes/`, `temp/`)
+- `logs/`: proxy, router and extractor logs
+
+## From a repository checkout
+Install editable with `pip install -e .`, then run `tbuffet init` and `tbuffet start` from the repository root.
+
+`tbuffet start` launches every provider proxy, the router (port 8090) and the dashboard (port 8080); `tbuffet stop` stops them. `tbuffet dashboard` starts the dashboard alone.
+
+The router listens on port 8090, and the dashboard is at `http://127.0.0.1:8080/`. See the [documentation index](docs/README.md) for the bridge guides.

token_buffet-0.2.2/pyproject.toml

@@ -0,0 +1,64 @@
+[build-system]
+requires = ["setuptools>=77.0"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "token-buffet"
+version = "0.2.2"
+authors = [
+  { name="Jack" },
+]
+description = "A pure-Python proxy and routing system to bridge CLI-based LLMs to a standard OpenAI-compatible API."
+readme = "README.md"
+requires-python = ">=3.12"
+keywords = ["llm", "proxy", "router", "openai-compatible", "cli", "claude", "codex", "grok", "ollama"]
+classifiers = [
+    "Development Status :: 3 - Alpha",
+    "Environment :: Console",
+    "Intended Audience :: Developers",
+    "Programming Language :: Python :: 3",
+    "Operating System :: OS Independent",
+    "Topic :: Software Development :: Libraries :: Application Frameworks",
+]
+license = "MIT"
+license-files = ["LICENSE"]
+# TODO(release): add [project.urls] once a public repo exists.
+dependencies = [
+    "psutil; sys_platform=='darwin'",
+    "pyte",
+    "pywinpty; sys_platform=='win32'",
+    "pexpect; sys_platform!='win32'",
+    "openai",
+    "ai",
+]
+
+[project.scripts]
+tokenbuffet = "tokenbuffet.cli:main"
+tbuffet = "tokenbuffet.cli:main"
+
+# include-package-data + MANIFEST.in grafts so dotfiles/dot-dirs in the
+# templates (.agents, .claude/.codex/.gemini/.grok, demo .obsidian) ship too;
+# a package-data "**/*" glob silently drops leading-dot names.
+[tool.setuptools]
+include-package-data = true
+
+[tool.setuptools.packages.find]
+where = ["src"]
+include = ["tokenbuffet*"]
+
+[project.optional-dependencies]
+capture = [
+    "pyte",
+    "pywinpty; sys_platform=='win32'",
+    "pexpect; sys_platform!='win32'",
+    "openai",
+]
+responses = ["openai"]
+uistream = ["ai"]
+all = [
+    "pyte",
+    "pywinpty; sys_platform=='win32'",
+    "pexpect; sys_platform!='win32'",
+    "openai",
+    "ai",
+]

token_buffet-0.2.2/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

token_buffet-0.2.2/src/token_buffet.egg-info/PKG-INFO

@@ -0,0 +1,112 @@
+Metadata-Version: 2.4
+Name: token-buffet
+Version: 0.2.2
+Summary: A pure-Python proxy and routing system to bridge CLI-based LLMs to a standard OpenAI-compatible API.
+Author: Jack
+License-Expression: MIT
+Keywords: llm,proxy,router,openai-compatible,cli,claude,codex,grok,ollama
+Classifier: Development Status :: 3 - Alpha
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Programming Language :: Python :: 3
+Classifier: Operating System :: OS Independent
+Classifier: Topic :: Software Development :: Libraries :: Application Frameworks
+Requires-Python: >=3.12
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: psutil; sys_platform == "darwin"
+Requires-Dist: pyte
+Requires-Dist: pywinpty; sys_platform == "win32"
+Requires-Dist: pexpect; sys_platform != "win32"
+Requires-Dist: openai
+Requires-Dist: ai
+Provides-Extra: capture
+Requires-Dist: pyte; extra == "capture"
+Requires-Dist: pywinpty; sys_platform == "win32" and extra == "capture"
+Requires-Dist: pexpect; sys_platform != "win32" and extra == "capture"
+Requires-Dist: openai; extra == "capture"
+Provides-Extra: responses
+Requires-Dist: openai; extra == "responses"
+Provides-Extra: uistream
+Requires-Dist: ai; extra == "uistream"
+Provides-Extra: all
+Requires-Dist: pyte; extra == "all"
+Requires-Dist: pywinpty; sys_platform == "win32" and extra == "all"
+Requires-Dist: pexpect; sys_platform != "win32" and extra == "all"
+Requires-Dist: openai; extra == "all"
+Requires-Dist: ai; extra == "all"
+Dynamic: license-file
+
+# Token Buffet: CLI LLM Proxy Router
+
+Expose your flat-rate CLI subscriptions (Claude, Codex, Grok, agy) as a local OpenAI/Ollama/Anthropic-compatible API. Route requests by semantic tier (`fast`/`medium`/`reasoning`), smart load balance by quota, and power your downstream tools without paying per token.
+
+## Learn the Concept
+
+For an overview of the LLM Wiki pattern and how this fits in, watch:
+
+**[Karpathy LLM Wiki Overview](https://www.youtube.com/watch?v=iXd0t60YmMw)**
+
+*(Note: The video uses Claude Code as the example, but explains the LLM Wiki concepts and patterns well. Token Buffet applies the same pattern to any CLI-based LLM subscription (Claude, Codex, Grok, agy) and powers Obsidian vaults, community plugins, and agent frameworks.)*
+
+This shows how to turn your subscriptions into a local knowledge-synthesis engine for tools like Obsidian, chatbot clients, and AI agents.
+
+## Features
+- **Small runtime:** The proxy, router, and dashboard use Python's standard HTTP server. Extractor capture needs its optional pseudo-terminal dependencies, and the Responses endpoint needs the OpenAI SDK.
+- **Semantic Routing:** Translates generic model requests (`fast`, `medium`, `reasoning`) into specific provider models based on remaining usage quotas.
+- **Smart Load Balancing:** Reads exported CLI quota files and routes requests to the provider with the most remaining quota.
+- **True Parallelism:** Spawns sandbox directories to bypass SQLite locking limits in native CLIs.
+
+## Architecture
+
+![AI Subscriptions Hub Architecture](res/AI_Subscription_Architecture_landscape.png)
+
+## Quick Start
+Token Buffet always works in the folder you run it from. Make one folder for it:
+
+```bash
+mkdir TokenBuffet && cd TokenBuffet
+pip install token-buffet               # Python 3.12+; installs everything it needs
+tbuffet init                           # scaffold, register the provider CLIs found on PATH, check app integrations
+tbuffet demo init                      # optional: copy the demos, add them to their apps, list which can run
+tbuffet start                          # proxies + router (8090) + dashboard (8080); Ctrl+C stops this session's process trees
+tbuffet start --background             # explicitly leave services running in the background
+tbuffet status | stop | restart | doctor
+```
+Log in to each vendor CLI (`claude`, `codex`, `grok`, `agy`) once. `init` doesn't check logins; a provider that isn't signed in reports its error at `tbuffet start`.
+
+### Demos (pre-configured)
+`tbuffet demo init` copies ready-to-use demos into `demo/`. Each one already points at the router, so after `tbuffet start`:
+- **Obsidian LLM Wiki** (needs Obsidian installed): run `tbuffet open obsidian conference-notes` (or `daily-notes`), then choose *Trust author and enable plugins*. See [the demo README](src/tokenbuffet/default_templates/demo/Obsidian-LLM-Wiki/README.md).
+- **Chatbots and Claudia:** see `demo/README.md`.
+
+### Providers and your own apps
+```bash
+tbuffet add-provider claude --validate        # register a built-in provider + login/quota check
+tbuffet add-provider mine --from config.json  # import a config authored with the register-provider skill
+tbuffet list-providers | remove-provider NAME
+tbuffet add-app obsidian my-vault --path "/path/to/vault" --vault-type daily-notes
+tbuffet list-apps | reconfigure-app TYPE NAME
+```
+
+## Directory Structure
+- `src/tokenbuffet/`: proxy, router, dashboard and launcher
+- `src/tokenbuffet/extractors/`: provider usage and model capture/parse engine
+- `src/tokenbuffet/default_templates/`: what `tbuffet init` copies into your folder:
+  - `config/`
+  - `integrations/` (built-in app types, and `providers/` with the built-in provider configs)
+  - `scripts/`
+  - `demo/` and the demo registrations in `registered_apps/` are copied by `tbuffet demo init`
+
+In your Token Buffet folder:
+- `integrations/providers/`: built-in provider configs (what Token Buffet supports)
+- `registered_providers/`: the providers registered on this machine
+- `data/`: runtime state (`providers_status/`, `provider_homes/`, `temp/`)
+- `logs/`: proxy, router and extractor logs
+
+## From a repository checkout
+Install editable with `pip install -e .`, then run `tbuffet init` and `tbuffet start` from the repository root.
+
+`tbuffet start` launches every provider proxy, the router (port 8090) and the dashboard (port 8080); `tbuffet stop` stops them. `tbuffet dashboard` starts the dashboard alone.
+
+The router listens on port 8090, and the dashboard is at `http://127.0.0.1:8080/`. See the [documentation index](docs/README.md) for the bridge guides.