Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
NVIDIA RTX 5090 · 32GB · llama.cpp
Other
3 days ago
277.25 tok/s
Decode
1,119.33 tok/s
Prefill
0.73 s
TTFT
12.5 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5090 · 32GB · Ollama
Other
3 days ago
166 tok/s
Decode
599.13 tok/s
Prefill
2.05 s
TTFT
19.68 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · vLLM
Other
3 days ago
115.94 tok/s
Decode
451.93 tok/s
Prefill
0.72 s
TTFT
13.82 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · vLLM
Other
3 days ago
83.86 tok/s
Decode
287.36 tok/s
Prefill
1.48 s
TTFT
19.68 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · Ollama
Other
3 days ago
85.51 tok/s
Decode
324.93 tok/s
Prefill
1.46 s
TTFT
16.84 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · vLLM
Other
3 days ago
222.48 tok/s
Decode
1,168.2 tok/s
Prefill
2.41 s
TTFT
14.57 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · vLLM
Other
3 days ago
163.05 tok/s
Decode
700.99 tok/s
Prefill
0.86 s
TTFT
19.11 GB
VRAM
Sources: Other · 2 runs · 1 independent sources
Apple M5 Max · 128GB · Strata
Other
3 days ago
284.27 tok/s
Decode
948.35 tok/s
Prefill
0.47 s
TTFT
14.95 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · llama.cpp
Other
3 days ago
110.08 tok/s
Decode
496.59 tok/s
Prefill
0.49 s
TTFT
21 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · Strata
Other
3 days ago
209.28 tok/s
Decode
1,036.76 tok/s
Prefill
1.89 s
TTFT
14.95 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA Jetson AGX Orin 64GB · 64GB · Ollama
Other
3 days ago
55.39 tok/s
Decode
272.09 tok/s
Prefill
1.38 s
TTFT
14.38 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA Jetson AGX Orin 64GB · 64GB · Strata
Other
3 days ago
72.01 tok/s
Decode
281.13 tok/s
Prefill
2.2 s
TTFT
17.6 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Halo (Radeon 8060S) · llama.cpp
Other
3 days ago
116.24 tok/s
Decode
433.01 tok/s
Prefill
0.63 s
TTFT
10.04 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Halo (Radeon 8060S) · llama.cpp
Other
3 days ago
60.47 tok/s
Decode
213.4 tok/s
Prefill
0.26 s
TTFT
19.11 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Halo (Radeon 8060S) · Strata
Other
3 days ago
105.67 tok/s
Decode
508.86 tok/s
Prefill
2.04 s
TTFT
16.84 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Halo (Radeon 8060S) · Strata
Other
3 days ago
73.08 tok/s
Decode
234.71 tok/s
Prefill
0.3 s
TTFT
21 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x AMD Strix Halo · Ollama
Other
3 days ago
58.36 tok/s
Decode
233.8 tok/s
Prefill
1.32 s
TTFT
37.06 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x AMD Strix Halo · Strata
Other
3 days ago
234.55 tok/s
Decode
886.87 tok/s
Prefill
0.55 s
TTFT
13.82 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Point (Radeon 890M) · vLLM
Other
3 days ago
65.94 tok/s
Decode
339.59 tok/s
Prefill
2.5 s
TTFT
14.57 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Point (Radeon 890M) · Ollama
Other
3 days ago
62.85 tok/s
Decode
248.56 tok/s
Prefill
1.31 s
TTFT
13.82 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
66 results