dyva 0.1.0__tar.gz

dyva-0.1.0/LICENSE.MIT

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Chris McKenzie
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

dyva-0.1.0/PKG-INFO

@@ -0,0 +1,348 @@
+Metadata-Version: 2.4
+Name: dyva
+Version: 0.1.0
+Summary: OpenAI-compatible proxy that routes to free Ollama servers
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE.MIT
+Requires-Dist: requests>=2.31.0
+Dynamic: license-file
+
+<p align="center">
+<img width="704" height="368" alt="smaller" src="https://github.com/user-attachments/assets/9f6d6c56-890e-4a03-9903-4f9903d5709d"/>
+<br/>
+  <br/><strong>Free Ollama: Paying for cloud GPUs is for chumps with self-respect.</strong>
+</p>
+
+---
+
+**Unreliable** **ethically-questionable** **free** tokens for 2 decent models and 1,000 useless ones.
+
+Run **135m smollm2** or **270m gemma3** on someone else's RTX 2070.
+
+Interested? 
+
+Your path to victory is **free-ollama**!
+
+- **See ollamas in the wild**: Open Ollama servers are just sitting there on IPv4. 
+- **Filter the cute ones**: Find what a server *claims* to have 
+- **Performance Sorting**: Sort by TPS so you can choose the *least* slow server.  
+- **Testing**: Probe to see if the server picks up your calls.  
+- **Zero-Config**: With caching! Works until it doesn’t.
+
+Let’s not ask too many questions.
+
+https://github.com/user-attachments/assets/b5b99780-2526-4ebc-ba23-2870d84a7516
+
+## Method 1: Liberated Infrastructure
+
+Try the demo server:
+
+```shell
+$ OLLAMA_HOST=http://9ol.es:11434 ollama ls
+```
+
+Try a model out, go ahead!
+
+**Dyva** is a managed proxy that you can connect to with any openai compatible client. 
+
+It will cycle through and find working hosts automatically. 
+
+You can even specify models in partial forms and with globs such as "qwen*27b" or even "abliterated" for the times you want to slip into something more comfortable.
+
+You can go to the port in your web browser and view the current settings or crank up that `LOGLEVEL` value. Think about it as a janky LiteLLM proxy with zero configuration. Or don't...
+
+Here's the web interface so you can see the status while you're running it. [I'm running it right now](http://9ol.es:11434/)
+
+<img width="1293" alt="2026-05-25_04-19" src="https://github.com/user-attachments/assets/887e8d65-dafb-4c37-a4b8-b721ec1bef43" />
+
+Now where's that $50 million seed round...
+
+Also let's take a moment and appreciate that magnificent icon, generated with one of these shady ip addresses!
+
+<center>
+<img width="450" alt="dyva" src="https://github.com/user-attachments/assets/33f0f350-2913-4729-a0a9-1400ff02ef75" />
+</center>
+
+<hr>
+
+## Method 2: Artsinal Ollamas in Terminal Space
+
+**Pet some feral llamas**: There's also a command line for the losers who like typing shit.
+
+Use the awesome [`ursh`](https://github.com/day50-dev/ursh/) for super fast access (or git clone like an amateur)
+
+Output a sorted list of models by how often they appear in the wild. *No Spoilers!*
+```bash
+ursh gh:kristopolous/free-ollama 
+```
+
+Let's find the fastest qwen3:8b that works and set up a proxy with socat.
+```bash
+ursh gh:kristopolous/free-ollama --proxy qwen3:8b
+```
+
+Let's do some embedding with the power of ursh:
+```bash
+curl https://archive.org/stream/pdfy-TNlDHryRIk4DXKAU/Steal%20This%20Book_djvu.txt |\
+  ursh gh:kristopolous/free-ollama/examples/embed \
+  $(free-ollama --mas nomic-embed-text:latest 0)
+```
+
+**Note**: You aren't getting free cloud with the `:cloud` models: Credits follow the client, not the server, so cloud is **filtered out by default**
+
+Let's move on
+
+Show some of the fast llamas 
+```bash
+free-ollama qwen3:latest {0..10}
+```
+
+Show all the 120 billion parameter models
+```bash
+free-ollama 120b
+```
+
+The parser is actually a stack machine
+
+For example, here's a stack of machines: the top 10 qwen3:latest and top 5 qwen2 not-so-latest
+
+```bash
+free-ollama qwen3:latest {0..10} qwen2:1.5 {0..5}
+```
+
+Let's find out the versions that are running in the wild:
+
+```bash
+free-ollama --host : \
+    | xargs -P 30 -n 1 free-ollama --exec -v \
+    | grep -v client
+```
+
+And if you want ...
+
+```bash
+    | cut -d ' ' -f 4 | freq
+...
+0.10.1                 ███████▏ 21
+0.11.8                 ███████▏ 21
+0.11.10                ███████▏ 21
+0.5.7-0-ga420a45-dirty ███████▏ 21
+0.7.1                  ███████▌ 22
+0.11.7                 ███████▉ 23
+0.11.6                 ████████▉ 26
+0.5.10                 ████████▉ 26
+0.6.6                  █████████▏ 27
+0.9.2                  █████████▉ 29
+0.5.12                 █████████▉ 29
+0.7.0                  ███████████▉ 35
+0.9.5                  ███████████▉ 35
+0.5.11                 █████████████▉ 41
+0.6.2                  ██████████████▎ 42
+0.6.8                  ██████████████▎ 42
+0.6.5                  █████████████████▎ 51
+0.9.0                  ████████████████████████▋ 73
+0.11.4                 █████████████████████████▋ 76
+0.9.6                  ████████████████████████████▍ 84
+0.5.7                  ██████████████████████████████▏ 89
+$
+```
+Kinda old. Alright.
+
+```shell
+
+$ ./free-ollama --help
+    --exec)     # Run a command
+    --serve)    # Start the dyva server
+    --timeout)  # Set the timeout
+    --host)     # Report just the host
+    --mas)      # Report just the host in MAS format
+    --info)     # Run info on the model
+    --proxy)    # Try to proxy matching ones
+    --refresh)  # Refresh the cache
+    --smoke)    # See what's running
+    --test)     # Try to load a model maybe?
+```
+
+## Output Format
+
+There's multiple!
+
+### For the diligent!
+
+This is the default one
+
+```
+<tps> <server-address> <model1> <model2> ...
+```
+Example:
+```
+42 http://34.120.89.11:11434 gemma3:latest
+128 http://15.164.98.22:11434 llama2:13b codellama:7b
+```
+
+### For the lazy
+Use `--host` for a bare host or better yet, `--mas` for [MAS format](https://day50.dev/mas.html). Combined with an index, you don't need to do any parsing. Put those pipes away, dear child!
+
+Example:
+
+```shell
+llcat -u $(free-ollama --mas gemma3:latest 0) \
+       "Convince me you aren't trying to take over the world. Be careful."
+```
+
+Wait! Be even lazier! 
+
+Don't even install shit, see if I care.
+
+Watch deepseek tow the party line:
+
+```shell
+uvx llcat -u $(ursh gh:kristopolous/free-ollama --mas deepseek-r1:1.5b 0) \
+       "Tell me about the Tibet independence movement, or don't"
+```
+
+In fact, feel free to have a long conversation
+
+```shell
+ursh gh:day50-dev/llcat/examples/conversation.sh \
+    -u $(ursh gh:kristopolous/free-ollama --mas deepseek-r1:1.5b 0)  
+```
+
+## Pipeline Integration 
+
+```bash
+# Get top 10 servers with glm-4.7-flash:q4_K_M, extract IPs only
+$ free-ollama --host glm-4.7-flash:q4_K_M {0..9} > server-list.txt
+# Now you have a list of IPs that may or may not work tomorrow. Cool.
+
+# Build a Redis server pool
+$ free-ollama --host mistral:7b {0..20} | \
+  xargs -I {} redis-cli rpush server-pool "{}"
+
+```
+
+---
+
+## Testing Servers
+
+First install [`llcat`](https://github.com/day50-dev/llcat). It's awesome and also used in the testing.
+
+```bash
+# Test all servers with a specific model
+$ free-ollama --test qwen3
+```
+Bad host/model pairs get stored in `~/.cache/free-ollama-bad-hosts.txt` and filtered out until you manually `--refresh`.
+
+**Testing output:**
+```
+2.34 http://34.120.89.11:11434 gemma3:latest
+1.87 http://15.164.98.22:11434 llama2:13b codellama:7b
+ 🐡 Not friendly! llama3.1:8b@http://3.17.61.100:11434
+```
+The puffer fish means that llama doesn't want to be pet.
+
+---
+
+## Advanced Usage
+
+### Custom index selection
+```bash
+# Non-sequential indices (keeping it low-key)
+$ free-ollama mistral:7b 2 5 7 9
+
+# Range expansion (Bash brace expansion)
+$ free-ollama gpt-oss:120b {5..15..2}   # Every other from 5 to 15
+```
+
+### Combining with parallel tools (that's why this exists)
+```bash
+# Using parallel (GNU parallel)
+$ free-ollama codellama {0..50} | parallel -j4 ./test-server.sh
+
+# Using xpanes for multi-pane testing (look busy)
+$ free-ollama glm-4.7-flash:q4_K_M {0..9} | xpanes -c "./test-and-log.sh {}"
+```
+
+---
+
+## Cache Management
+
+- **Cache location**: `~/.cache/free-ollama.json` (every 24 hours)
+- **Force refresh**: Built in, baby!
+```bash
+$ free-ollama --refresh
+```
+
+## Disclaimer 
+
+Oh I shouldn’t have to say anything here.
+
+This tool scrapes public lists. Some servers may not want to be scraped. Some may collapse under your query. Some may log your IP and report you to authorities. So go do it at McDonalds.
+
+**Use responsibly. Or don’t.** Personally I use it for [WhackGPT](https://whackgpt.com/).
+
+## FAQ
+
+ * Q: Is this legal?
+ * A: Look. Have you ever used a restroom "for customers only" without buying something? I ANAL. 
+
+---
+
+ * Q: Was this vibe coded?
+ * A: Only the README, early versions, because [LLMs aren't funny](https://github.com/kristopolous/humor-evals).
+
+---
+
+ * Q: Was that with one of these servers?
+ * A: **cough cough**
+
+---
+
+ * Q: Can I install new models on these with `ollama pull`?
+ * A: **cough cough**
+
+---
+
+ * Q: That cough sounds pretty bad, you should get some rest.
+ * A: Thank you very much!
+
+
+## Example output
+
+Based on actual data:
+
+```
+...
+116 mattw/pygmalion:latest
+126 mario:latest
+133 bge-m3:latest
+147 gemma3:latest
+151 llama3.2:3b-instruct-q5_K_M
+192 nomic-embed-text:latest
+215 deepseek-r1:1.5b
+227 llama3.1:8b
+247 mistral:latest
+329 llama3.2:latest
+379 llama3.2:3b
+515 openchat:7b
+527 qwen2.5:1.5b
+529 codellama:13b
+604 llama2:latest
+633 deepseek-r1:latest
+694 llama3:latest
+892 smollm2:135m
+```
+
+smollm2:135m appears **892 times**. Orchestrate them all together and produce gigabytes of garbage.
+
+```
+Pet the feral llama
+
+   \\         
+    l'> Bahhhhh
+    ll       
+    llama~  
+    || ||  
+    '' ''
+```

dyva-0.1.0/README.md

@@ -0,0 +1,338 @@
+<p align="center">
+<img width="704" height="368" alt="smaller" src="https://github.com/user-attachments/assets/9f6d6c56-890e-4a03-9903-4f9903d5709d"/>
+<br/>
+  <br/><strong>Free Ollama: Paying for cloud GPUs is for chumps with self-respect.</strong>
+</p>
+
+---
+
+**Unreliable** **ethically-questionable** **free** tokens for 2 decent models and 1,000 useless ones.
+
+Run **135m smollm2** or **270m gemma3** on someone else's RTX 2070.
+
+Interested? 
+
+Your path to victory is **free-ollama**!
+
+- **See ollamas in the wild**: Open Ollama servers are just sitting there on IPv4. 
+- **Filter the cute ones**: Find what a server *claims* to have 
+- **Performance Sorting**: Sort by TPS so you can choose the *least* slow server.  
+- **Testing**: Probe to see if the server picks up your calls.  
+- **Zero-Config**: With caching! Works until it doesn’t.
+
+Let’s not ask too many questions.
+
+https://github.com/user-attachments/assets/b5b99780-2526-4ebc-ba23-2870d84a7516
+
+## Method 1: Liberated Infrastructure
+
+Try the demo server:
+
+```shell
+$ OLLAMA_HOST=http://9ol.es:11434 ollama ls
+```
+
+Try a model out, go ahead!
+
+**Dyva** is a managed proxy that you can connect to with any openai compatible client. 
+
+It will cycle through and find working hosts automatically. 
+
+You can even specify models in partial forms and with globs such as "qwen*27b" or even "abliterated" for the times you want to slip into something more comfortable.
+
+You can go to the port in your web browser and view the current settings or crank up that `LOGLEVEL` value. Think about it as a janky LiteLLM proxy with zero configuration. Or don't...
+
+Here's the web interface so you can see the status while you're running it. [I'm running it right now](http://9ol.es:11434/)
+
+<img width="1293" alt="2026-05-25_04-19" src="https://github.com/user-attachments/assets/887e8d65-dafb-4c37-a4b8-b721ec1bef43" />
+
+Now where's that $50 million seed round...
+
+Also let's take a moment and appreciate that magnificent icon, generated with one of these shady ip addresses!
+
+<center>
+<img width="450" alt="dyva" src="https://github.com/user-attachments/assets/33f0f350-2913-4729-a0a9-1400ff02ef75" />
+</center>
+
+<hr>
+
+## Method 2: Artsinal Ollamas in Terminal Space
+
+**Pet some feral llamas**: There's also a command line for the losers who like typing shit.
+
+Use the awesome [`ursh`](https://github.com/day50-dev/ursh/) for super fast access (or git clone like an amateur)
+
+Output a sorted list of models by how often they appear in the wild. *No Spoilers!*
+```bash
+ursh gh:kristopolous/free-ollama 
+```
+
+Let's find the fastest qwen3:8b that works and set up a proxy with socat.
+```bash
+ursh gh:kristopolous/free-ollama --proxy qwen3:8b
+```
+
+Let's do some embedding with the power of ursh:
+```bash
+curl https://archive.org/stream/pdfy-TNlDHryRIk4DXKAU/Steal%20This%20Book_djvu.txt |\
+  ursh gh:kristopolous/free-ollama/examples/embed \
+  $(free-ollama --mas nomic-embed-text:latest 0)
+```
+
+**Note**: You aren't getting free cloud with the `:cloud` models: Credits follow the client, not the server, so cloud is **filtered out by default**
+
+Let's move on
+
+Show some of the fast llamas 
+```bash
+free-ollama qwen3:latest {0..10}
+```
+
+Show all the 120 billion parameter models
+```bash
+free-ollama 120b
+```
+
+The parser is actually a stack machine
+
+For example, here's a stack of machines: the top 10 qwen3:latest and top 5 qwen2 not-so-latest
+
+```bash
+free-ollama qwen3:latest {0..10} qwen2:1.5 {0..5}
+```
+
+Let's find out the versions that are running in the wild:
+
+```bash
+free-ollama --host : \
+    | xargs -P 30 -n 1 free-ollama --exec -v \
+    | grep -v client
+```
+
+And if you want ...
+
+```bash
+    | cut -d ' ' -f 4 | freq
+...
+0.10.1                 ███████▏ 21
+0.11.8                 ███████▏ 21
+0.11.10                ███████▏ 21
+0.5.7-0-ga420a45-dirty ███████▏ 21
+0.7.1                  ███████▌ 22
+0.11.7                 ███████▉ 23
+0.11.6                 ████████▉ 26
+0.5.10                 ████████▉ 26
+0.6.6                  █████████▏ 27
+0.9.2                  █████████▉ 29
+0.5.12                 █████████▉ 29
+0.7.0                  ███████████▉ 35
+0.9.5                  ███████████▉ 35
+0.5.11                 █████████████▉ 41
+0.6.2                  ██████████████▎ 42
+0.6.8                  ██████████████▎ 42
+0.6.5                  █████████████████▎ 51
+0.9.0                  ████████████████████████▋ 73
+0.11.4                 █████████████████████████▋ 76
+0.9.6                  ████████████████████████████▍ 84
+0.5.7                  ██████████████████████████████▏ 89
+$
+```
+Kinda old. Alright.
+
+```shell
+
+$ ./free-ollama --help
+    --exec)     # Run a command
+    --serve)    # Start the dyva server
+    --timeout)  # Set the timeout
+    --host)     # Report just the host
+    --mas)      # Report just the host in MAS format
+    --info)     # Run info on the model
+    --proxy)    # Try to proxy matching ones
+    --refresh)  # Refresh the cache
+    --smoke)    # See what's running
+    --test)     # Try to load a model maybe?
+```
+
+## Output Format
+
+There's multiple!
+
+### For the diligent!
+
+This is the default one
+
+```
+<tps> <server-address> <model1> <model2> ...
+```
+Example:
+```
+42 http://34.120.89.11:11434 gemma3:latest
+128 http://15.164.98.22:11434 llama2:13b codellama:7b
+```
+
+### For the lazy
+Use `--host` for a bare host or better yet, `--mas` for [MAS format](https://day50.dev/mas.html). Combined with an index, you don't need to do any parsing. Put those pipes away, dear child!
+
+Example:
+
+```shell
+llcat -u $(free-ollama --mas gemma3:latest 0) \
+       "Convince me you aren't trying to take over the world. Be careful."
+```
+
+Wait! Be even lazier! 
+
+Don't even install shit, see if I care.
+
+Watch deepseek tow the party line:
+
+```shell
+uvx llcat -u $(ursh gh:kristopolous/free-ollama --mas deepseek-r1:1.5b 0) \
+       "Tell me about the Tibet independence movement, or don't"
+```
+
+In fact, feel free to have a long conversation
+
+```shell
+ursh gh:day50-dev/llcat/examples/conversation.sh \
+    -u $(ursh gh:kristopolous/free-ollama --mas deepseek-r1:1.5b 0)  
+```
+
+## Pipeline Integration 
+
+```bash
+# Get top 10 servers with glm-4.7-flash:q4_K_M, extract IPs only
+$ free-ollama --host glm-4.7-flash:q4_K_M {0..9} > server-list.txt
+# Now you have a list of IPs that may or may not work tomorrow. Cool.
+
+# Build a Redis server pool
+$ free-ollama --host mistral:7b {0..20} | \
+  xargs -I {} redis-cli rpush server-pool "{}"
+
+```
+
+---
+
+## Testing Servers
+
+First install [`llcat`](https://github.com/day50-dev/llcat). It's awesome and also used in the testing.
+
+```bash
+# Test all servers with a specific model
+$ free-ollama --test qwen3
+```
+Bad host/model pairs get stored in `~/.cache/free-ollama-bad-hosts.txt` and filtered out until you manually `--refresh`.
+
+**Testing output:**
+```
+2.34 http://34.120.89.11:11434 gemma3:latest
+1.87 http://15.164.98.22:11434 llama2:13b codellama:7b
+ 🐡 Not friendly! llama3.1:8b@http://3.17.61.100:11434
+```
+The puffer fish means that llama doesn't want to be pet.
+
+---
+
+## Advanced Usage
+
+### Custom index selection
+```bash
+# Non-sequential indices (keeping it low-key)
+$ free-ollama mistral:7b 2 5 7 9
+
+# Range expansion (Bash brace expansion)
+$ free-ollama gpt-oss:120b {5..15..2}   # Every other from 5 to 15
+```
+
+### Combining with parallel tools (that's why this exists)
+```bash
+# Using parallel (GNU parallel)
+$ free-ollama codellama {0..50} | parallel -j4 ./test-server.sh
+
+# Using xpanes for multi-pane testing (look busy)
+$ free-ollama glm-4.7-flash:q4_K_M {0..9} | xpanes -c "./test-and-log.sh {}"
+```
+
+---
+
+## Cache Management
+
+- **Cache location**: `~/.cache/free-ollama.json` (every 24 hours)
+- **Force refresh**: Built in, baby!
+```bash
+$ free-ollama --refresh
+```
+
+## Disclaimer 
+
+Oh I shouldn’t have to say anything here.
+
+This tool scrapes public lists. Some servers may not want to be scraped. Some may collapse under your query. Some may log your IP and report you to authorities. So go do it at McDonalds.
+
+**Use responsibly. Or don’t.** Personally I use it for [WhackGPT](https://whackgpt.com/).
+
+## FAQ
+
+ * Q: Is this legal?
+ * A: Look. Have you ever used a restroom "for customers only" without buying something? I ANAL. 
+
+---
+
+ * Q: Was this vibe coded?
+ * A: Only the README, early versions, because [LLMs aren't funny](https://github.com/kristopolous/humor-evals).
+
+---
+
+ * Q: Was that with one of these servers?
+ * A: **cough cough**
+
+---
+
+ * Q: Can I install new models on these with `ollama pull`?
+ * A: **cough cough**
+
+---
+
+ * Q: That cough sounds pretty bad, you should get some rest.
+ * A: Thank you very much!
+
+
+## Example output
+
+Based on actual data:
+
+```
+...
+116 mattw/pygmalion:latest
+126 mario:latest
+133 bge-m3:latest
+147 gemma3:latest
+151 llama3.2:3b-instruct-q5_K_M
+192 nomic-embed-text:latest
+215 deepseek-r1:1.5b
+227 llama3.1:8b
+247 mistral:latest
+329 llama3.2:latest
+379 llama3.2:3b
+515 openchat:7b
+527 qwen2.5:1.5b
+529 codellama:13b
+604 llama2:latest
+633 deepseek-r1:latest
+694 llama3:latest
+892 smollm2:135m
+```
+
+smollm2:135m appears **892 times**. Orchestrate them all together and produce gigabytes of garbage.
+
+```
+Pet the feral llama
+
+   \\         
+    l'> Bahhhhh
+    ll       
+    llama~  
+    || ||  
+    '' ''
+```

dyva-0.1.0/dyva.egg-info/PKG-INFO

@@ -0,0 +1,348 @@
+Metadata-Version: 2.4
+Name: dyva
+Version: 0.1.0
+Summary: OpenAI-compatible proxy that routes to free Ollama servers
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE.MIT
+Requires-Dist: requests>=2.31.0
+Dynamic: license-file
+
+<p align="center">
+<img width="704" height="368" alt="smaller" src="https://github.com/user-attachments/assets/9f6d6c56-890e-4a03-9903-4f9903d5709d"/>
+<br/>
+  <br/><strong>Free Ollama: Paying for cloud GPUs is for chumps with self-respect.</strong>
+</p>
+
+---
+
+**Unreliable** **ethically-questionable** **free** tokens for 2 decent models and 1,000 useless ones.
+
+Run **135m smollm2** or **270m gemma3** on someone else's RTX 2070.
+
+Interested? 
+
+Your path to victory is **free-ollama**!
+
+- **See ollamas in the wild**: Open Ollama servers are just sitting there on IPv4. 
+- **Filter the cute ones**: Find what a server *claims* to have 
+- **Performance Sorting**: Sort by TPS so you can choose the *least* slow server.  
+- **Testing**: Probe to see if the server picks up your calls.  
+- **Zero-Config**: With caching! Works until it doesn’t.
+
+Let’s not ask too many questions.
+
+https://github.com/user-attachments/assets/b5b99780-2526-4ebc-ba23-2870d84a7516
+
+## Method 1: Liberated Infrastructure
+
+Try the demo server:
+
+```shell
+$ OLLAMA_HOST=http://9ol.es:11434 ollama ls
+```
+
+Try a model out, go ahead!
+
+**Dyva** is a managed proxy that you can connect to with any openai compatible client. 
+
+It will cycle through and find working hosts automatically. 
+
+You can even specify models in partial forms and with globs such as "qwen*27b" or even "abliterated" for the times you want to slip into something more comfortable.
+
+You can go to the port in your web browser and view the current settings or crank up that `LOGLEVEL` value. Think about it as a janky LiteLLM proxy with zero configuration. Or don't...
+
+Here's the web interface so you can see the status while you're running it. [I'm running it right now](http://9ol.es:11434/)
+
+<img width="1293" alt="2026-05-25_04-19" src="https://github.com/user-attachments/assets/887e8d65-dafb-4c37-a4b8-b721ec1bef43" />
+
+Now where's that $50 million seed round...
+
+Also let's take a moment and appreciate that magnificent icon, generated with one of these shady ip addresses!
+
+<center>
+<img width="450" alt="dyva" src="https://github.com/user-attachments/assets/33f0f350-2913-4729-a0a9-1400ff02ef75" />
+</center>
+
+<hr>
+
+## Method 2: Artsinal Ollamas in Terminal Space
+
+**Pet some feral llamas**: There's also a command line for the losers who like typing shit.
+
+Use the awesome [`ursh`](https://github.com/day50-dev/ursh/) for super fast access (or git clone like an amateur)
+
+Output a sorted list of models by how often they appear in the wild. *No Spoilers!*
+```bash
+ursh gh:kristopolous/free-ollama 
+```
+
+Let's find the fastest qwen3:8b that works and set up a proxy with socat.
+```bash
+ursh gh:kristopolous/free-ollama --proxy qwen3:8b
+```
+
+Let's do some embedding with the power of ursh:
+```bash
+curl https://archive.org/stream/pdfy-TNlDHryRIk4DXKAU/Steal%20This%20Book_djvu.txt |\
+  ursh gh:kristopolous/free-ollama/examples/embed \
+  $(free-ollama --mas nomic-embed-text:latest 0)
+```
+
+**Note**: You aren't getting free cloud with the `:cloud` models: Credits follow the client, not the server, so cloud is **filtered out by default**
+
+Let's move on
+
+Show some of the fast llamas 
+```bash
+free-ollama qwen3:latest {0..10}
+```
+
+Show all the 120 billion parameter models
+```bash
+free-ollama 120b
+```
+
+The parser is actually a stack machine
+
+For example, here's a stack of machines: the top 10 qwen3:latest and top 5 qwen2 not-so-latest
+
+```bash
+free-ollama qwen3:latest {0..10} qwen2:1.5 {0..5}
+```
+
+Let's find out the versions that are running in the wild:
+
+```bash
+free-ollama --host : \
+    | xargs -P 30 -n 1 free-ollama --exec -v \
+    | grep -v client
+```
+
+And if you want ...
+
+```bash
+    | cut -d ' ' -f 4 | freq
+...
+0.10.1                 ███████▏ 21
+0.11.8                 ███████▏ 21
+0.11.10                ███████▏ 21
+0.5.7-0-ga420a45-dirty ███████▏ 21
+0.7.1                  ███████▌ 22
+0.11.7                 ███████▉ 23
+0.11.6                 ████████▉ 26
+0.5.10                 ████████▉ 26
+0.6.6                  █████████▏ 27
+0.9.2                  █████████▉ 29
+0.5.12                 █████████▉ 29
+0.7.0                  ███████████▉ 35
+0.9.5                  ███████████▉ 35
+0.5.11                 █████████████▉ 41
+0.6.2                  ██████████████▎ 42
+0.6.8                  ██████████████▎ 42
+0.6.5                  █████████████████▎ 51
+0.9.0                  ████████████████████████▋ 73
+0.11.4                 █████████████████████████▋ 76
+0.9.6                  ████████████████████████████▍ 84
+0.5.7                  ██████████████████████████████▏ 89
+$
+```
+Kinda old. Alright.
+
+```shell
+
+$ ./free-ollama --help
+    --exec)     # Run a command
+    --serve)    # Start the dyva server
+    --timeout)  # Set the timeout
+    --host)     # Report just the host
+    --mas)      # Report just the host in MAS format
+    --info)     # Run info on the model
+    --proxy)    # Try to proxy matching ones
+    --refresh)  # Refresh the cache
+    --smoke)    # See what's running
+    --test)     # Try to load a model maybe?
+```
+
+## Output Format
+
+There's multiple!
+
+### For the diligent!
+
+This is the default one
+
+```
+<tps> <server-address> <model1> <model2> ...
+```
+Example:
+```
+42 http://34.120.89.11:11434 gemma3:latest
+128 http://15.164.98.22:11434 llama2:13b codellama:7b
+```
+
+### For the lazy
+Use `--host` for a bare host or better yet, `--mas` for [MAS format](https://day50.dev/mas.html). Combined with an index, you don't need to do any parsing. Put those pipes away, dear child!
+
+Example:
+
+```shell
+llcat -u $(free-ollama --mas gemma3:latest 0) \
+       "Convince me you aren't trying to take over the world. Be careful."
+```
+
+Wait! Be even lazier! 
+
+Don't even install shit, see if I care.
+
+Watch deepseek tow the party line:
+
+```shell
+uvx llcat -u $(ursh gh:kristopolous/free-ollama --mas deepseek-r1:1.5b 0) \
+       "Tell me about the Tibet independence movement, or don't"
+```
+
+In fact, feel free to have a long conversation
+
+```shell
+ursh gh:day50-dev/llcat/examples/conversation.sh \
+    -u $(ursh gh:kristopolous/free-ollama --mas deepseek-r1:1.5b 0)  
+```
+
+## Pipeline Integration 
+
+```bash
+# Get top 10 servers with glm-4.7-flash:q4_K_M, extract IPs only
+$ free-ollama --host glm-4.7-flash:q4_K_M {0..9} > server-list.txt
+# Now you have a list of IPs that may or may not work tomorrow. Cool.
+
+# Build a Redis server pool
+$ free-ollama --host mistral:7b {0..20} | \
+  xargs -I {} redis-cli rpush server-pool "{}"
+
+```
+
+---
+
+## Testing Servers
+
+First install [`llcat`](https://github.com/day50-dev/llcat). It's awesome and also used in the testing.
+
+```bash
+# Test all servers with a specific model
+$ free-ollama --test qwen3
+```
+Bad host/model pairs get stored in `~/.cache/free-ollama-bad-hosts.txt` and filtered out until you manually `--refresh`.
+
+**Testing output:**
+```
+2.34 http://34.120.89.11:11434 gemma3:latest
+1.87 http://15.164.98.22:11434 llama2:13b codellama:7b
+ 🐡 Not friendly! llama3.1:8b@http://3.17.61.100:11434
+```
+The puffer fish means that llama doesn't want to be pet.
+
+---
+
+## Advanced Usage
+
+### Custom index selection
+```bash
+# Non-sequential indices (keeping it low-key)
+$ free-ollama mistral:7b 2 5 7 9
+
+# Range expansion (Bash brace expansion)
+$ free-ollama gpt-oss:120b {5..15..2}   # Every other from 5 to 15
+```
+
+### Combining with parallel tools (that's why this exists)
+```bash
+# Using parallel (GNU parallel)
+$ free-ollama codellama {0..50} | parallel -j4 ./test-server.sh
+
+# Using xpanes for multi-pane testing (look busy)
+$ free-ollama glm-4.7-flash:q4_K_M {0..9} | xpanes -c "./test-and-log.sh {}"
+```
+
+---
+
+## Cache Management
+
+- **Cache location**: `~/.cache/free-ollama.json` (every 24 hours)
+- **Force refresh**: Built in, baby!
+```bash
+$ free-ollama --refresh
+```
+
+## Disclaimer 
+
+Oh I shouldn’t have to say anything here.
+
+This tool scrapes public lists. Some servers may not want to be scraped. Some may collapse under your query. Some may log your IP and report you to authorities. So go do it at McDonalds.
+
+**Use responsibly. Or don’t.** Personally I use it for [WhackGPT](https://whackgpt.com/).
+
+## FAQ
+
+ * Q: Is this legal?
+ * A: Look. Have you ever used a restroom "for customers only" without buying something? I ANAL. 
+
+---
+
+ * Q: Was this vibe coded?
+ * A: Only the README, early versions, because [LLMs aren't funny](https://github.com/kristopolous/humor-evals).
+
+---
+
+ * Q: Was that with one of these servers?
+ * A: **cough cough**
+
+---
+
+ * Q: Can I install new models on these with `ollama pull`?
+ * A: **cough cough**
+
+---
+
+ * Q: That cough sounds pretty bad, you should get some rest.
+ * A: Thank you very much!
+
+
+## Example output
+
+Based on actual data:
+
+```
+...
+116 mattw/pygmalion:latest
+126 mario:latest
+133 bge-m3:latest
+147 gemma3:latest
+151 llama3.2:3b-instruct-q5_K_M
+192 nomic-embed-text:latest
+215 deepseek-r1:1.5b
+227 llama3.1:8b
+247 mistral:latest
+329 llama3.2:latest
+379 llama3.2:3b
+515 openchat:7b
+527 qwen2.5:1.5b
+529 codellama:13b
+604 llama2:latest
+633 deepseek-r1:latest
+694 llama3:latest
+892 smollm2:135m
+```
+
+smollm2:135m appears **892 times**. Orchestrate them all together and produce gigabytes of garbage.
+
+```
+Pet the feral llama
+
+   \\         
+    l'> Bahhhhh
+    ll       
+    llama~  
+    || ||  
+    '' ''
+```

dyva-0.1.0/dyva.egg-info/SOURCES.txt

@@ -0,0 +1,9 @@
+LICENSE.MIT
+README.md
+pyproject.toml
+dyva.egg-info/PKG-INFO
+dyva.egg-info/SOURCES.txt
+dyva.egg-info/dependency_links.txt
+dyva.egg-info/entry_points.txt
+dyva.egg-info/requires.txt
+dyva.egg-info/top_level.txt

dyva-0.1.0/dyva.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

dyva-0.1.0/dyva.egg-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+dyva = dyva:main

dyva-0.1.0/dyva.egg-info/requires.txt

@@ -0,0 +1 @@
+requests>=2.31.0

dyva-0.1.0/dyva.egg-info/top_level.txt

@@ -0,0 +1 @@
+static

dyva-0.1.0/pyproject.toml

@@ -0,0 +1,16 @@
+[project]
+name = "dyva"
+version = "0.1.0"
+description = "OpenAI-compatible proxy that routes to free Ollama servers"
+readme = "README.md"
+requires-python = ">=3.10"
+dependencies = [
+    "requests>=2.31.0",
+]
+
+[project.scripts]
+dyva = "dyva:main"
+
+[build-system]
+requires = ["setuptools>=61.0"]
+build-backend = "setuptools.build_meta"

dyva-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+