ollama-bench 1.0.0 → 1.0.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +43 -25
- package/package.json +9 -1
- package/bun.lockb +0 -0
package/README.md
CHANGED
|
@@ -1,43 +1,61 @@
|
|
|
1
|
-
#
|
|
1
|
+
# Ollama Benchmark Script
|
|
2
|
+
A command-line tool to benchmark and compare the performance of Ollama language models. Measures tokens per second, memory usage, and total processing time.
|
|
3
|
+
|
|
4
|
+
## Setup
|
|
5
|
+
|
|
6
|
+
### 1. Install Ollama
|
|
7
|
+
Choose your platform:
|
|
8
|
+
- **Windows:** [Download Installer](https://ollama.com/download/OllamaSetup.exe)
|
|
9
|
+
- **macOS:** [Download App](https://ollama.com/download/Ollama-darwin.zip)
|
|
10
|
+
- **Linux:** Run:
|
|
11
|
+
```bash
|
|
12
|
+
curl -fsSL https://ollama.com/install.sh | sh
|
|
13
|
+
```
|
|
14
|
+
- **Docker:** Pull and run:
|
|
15
|
+
```bash
|
|
16
|
+
docker pull ollama/ollama
|
|
17
|
+
docker run -d -v ollama:/root/.ollama -p 11434:11434 ollama/ollama
|
|
18
|
+
```
|
|
19
|
+
|
|
20
|
+
### 2. Start Ollama Server
|
|
21
|
+
Before running any benchmarks, make sure the Ollama server is running:
|
|
2
22
|
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
- Node.js >= 14.0.0
|
|
8
|
-
- Ollama installed and running on your system
|
|
23
|
+
```bash
|
|
24
|
+
# On Linux/macOS terminal or Windows PowerShell
|
|
25
|
+
ollama serve
|
|
26
|
+
```
|
|
9
27
|
|
|
10
|
-
|
|
28
|
+
For Windows users, you can also run Ollama from the system tray after installation.
|
|
11
29
|
|
|
12
|
-
|
|
30
|
+
### 3. Install Benchmark Tool
|
|
31
|
+
Install globally:
|
|
13
32
|
```bash
|
|
14
|
-
npm install -g ollama-
|
|
33
|
+
npm install -g ollama-benchmark
|
|
15
34
|
```
|
|
16
|
-
|
|
17
35
|
Or run directly with npx:
|
|
18
36
|
```bash
|
|
19
|
-
npx ollama-
|
|
37
|
+
npx ollama-benchmark <model1> [model2] [model3]
|
|
20
38
|
```
|
|
21
39
|
|
|
22
40
|
## Usage
|
|
23
|
-
|
|
24
41
|
```bash
|
|
25
|
-
|
|
42
|
+
# Using global installation
|
|
43
|
+
ollama-benchmark smollm:135m qwen2.5:0.5b
|
|
44
|
+
|
|
45
|
+
# Using npx (no installation required)
|
|
46
|
+
npx ollama-benchmark smollm:135m qwen2.5:0.5b
|
|
26
47
|
```
|
|
27
48
|
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
49
|
+
## Troubleshooting
|
|
50
|
+
|
|
51
|
+
If you encounter errors, check:
|
|
52
|
+
1. Is the Ollama server running? (`ollama serve`)
|
|
53
|
+
2. Can you access `http://localhost:11434`?
|
|
54
|
+
3. Do you have enough RAM for your chosen models?
|
|
33
55
|
|
|
34
|
-
##
|
|
56
|
+
## Available Models
|
|
35
57
|
|
|
36
|
-
|
|
37
|
-
- Loading animations during operations
|
|
38
|
-
- Color-coded status messages
|
|
39
|
-
- Detailed benchmark results
|
|
40
|
-
- Comparison of model performance
|
|
58
|
+
See [ollama.com/library](https://ollama.com/library) for all available models.
|
|
41
59
|
|
|
42
60
|
## License
|
|
43
61
|
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "ollama-bench",
|
|
3
|
-
"version": "1.0.
|
|
3
|
+
"version": "1.0.2",
|
|
4
4
|
"description": "A CLI tool to benchmark Ollama models performance",
|
|
5
5
|
"main": "dist/index.js",
|
|
6
6
|
"type": "module",
|
|
@@ -15,6 +15,14 @@
|
|
|
15
15
|
"keywords": ["ollama", "benchmark", "ai", "models", "cli"],
|
|
16
16
|
"author": "dalist1",
|
|
17
17
|
"license": "MIT",
|
|
18
|
+
"repository": {
|
|
19
|
+
"type": "git",
|
|
20
|
+
"url": "git+https://github.com/dalist1/ollama-bench.git"
|
|
21
|
+
},
|
|
22
|
+
"bugs": {
|
|
23
|
+
"url": "https://github.com/dalist1/ollama-bench/issues"
|
|
24
|
+
},
|
|
25
|
+
"homepage": "https://github.com/dalist1/ollama-bench#readme",
|
|
18
26
|
"dependencies": {
|
|
19
27
|
"ollama": "latest"
|
|
20
28
|
},
|
package/bun.lockb
DELETED
|
Binary file
|