ollama-bench 1.0.0 → 1.0.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +28 -22
- package/package.json +1 -1
- package/bun.lockb +0 -0
package/README.md
CHANGED
|
@@ -1,43 +1,49 @@
|
|
|
1
|
-
#
|
|
1
|
+
# Ollama Benchmark Script
|
|
2
2
|
|
|
3
|
-
A command-line tool to benchmark Ollama models
|
|
3
|
+
A command-line tool to benchmark and compare the performance of Ollama language models. Measures tokens per second, memory usage, and total processing time.
|
|
4
4
|
|
|
5
|
-
##
|
|
5
|
+
## Setup
|
|
6
6
|
|
|
7
|
-
|
|
8
|
-
- Ollama installed and running on your system
|
|
7
|
+
### 1. Install Ollama
|
|
9
8
|
|
|
10
|
-
|
|
9
|
+
Choose your platform:
|
|
11
10
|
|
|
12
|
-
|
|
11
|
+
- **Windows:** [Download Installer](https://ollama.com/download/OllamaSetup.exe)
|
|
12
|
+
- **macOS:** [Download App](https://ollama.com/download/Ollama-darwin.zip)
|
|
13
|
+
- **Linux:** Run:
|
|
14
|
+
```bash
|
|
15
|
+
curl -fsSL https://ollama.com/install.sh | sh
|
|
16
|
+
```
|
|
17
|
+
- **Docker:** Pull and run:
|
|
18
|
+
```bash
|
|
19
|
+
docker pull ollama/ollama
|
|
20
|
+
docker run -d -v ollama:/root/.ollama -p 11434:11434 ollama/ollama
|
|
21
|
+
```
|
|
22
|
+
|
|
23
|
+
### 2. Install Benchmark Tool
|
|
24
|
+
|
|
25
|
+
Install globally:
|
|
13
26
|
```bash
|
|
14
|
-
npm install -g ollama-
|
|
27
|
+
npm install -g ollama-benchmark
|
|
15
28
|
```
|
|
16
29
|
|
|
17
30
|
Or run directly with npx:
|
|
18
31
|
```bash
|
|
19
|
-
npx ollama-
|
|
32
|
+
npx ollama-benchmark <model1> [model2] [model3]
|
|
20
33
|
```
|
|
21
34
|
|
|
22
35
|
## Usage
|
|
23
36
|
|
|
24
37
|
```bash
|
|
25
|
-
|
|
26
|
-
|
|
38
|
+
# Using global installation
|
|
39
|
+
ollama-benchmark smollm:135m qwen2.5:0.5b
|
|
27
40
|
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
3. Compare and display the results
|
|
32
|
-
4. Show the best performing model
|
|
41
|
+
# Using npx (no installation required)
|
|
42
|
+
npx ollama-benchmark smollm:135m qwen2.5:0.5b
|
|
43
|
+
```
|
|
33
44
|
|
|
34
|
-
## Output
|
|
35
45
|
|
|
36
|
-
|
|
37
|
-
- Loading animations during operations
|
|
38
|
-
- Color-coded status messages
|
|
39
|
-
- Detailed benchmark results
|
|
40
|
-
- Comparison of model performance
|
|
46
|
+
See [ollama.com/library](https://ollama.com/library) for all available models.
|
|
41
47
|
|
|
42
48
|
## License
|
|
43
49
|
|
package/package.json
CHANGED
package/bun.lockb
DELETED
|
Binary file
|