Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
NVIDIA RTX Spark · 128GB · llama.cpp
Other
16 days ago
5.5 tok/s
Decode
19.76 tok/s
Prefill
1.91 s
TTFT
107 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · llama.cpp
Other
16 days ago
8.41 tok/s
Decode
32.22 tok/s
Prefill
1.31 s
TTFT
54.83 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · llama.cpp
Other
16 days ago
7.68 tok/s
Decode
32.82 tok/s
Prefill
2.63 s
TTFT
67.3 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · Ollama
Other
16 days ago
8.83 tok/s
Decode
30.38 tok/s
Prefill
2.48 s
TTFT
54.83 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · Ollama
Other
16 days ago
6.72 tok/s
Decode
25.96 tok/s
Prefill
3.19 s
TTFT
67.3 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 3090 · 24GB · vLLM
Other
17 days ago
96.12 tok/s
Decode
373.79 tok/s
Prefill
0.28 s
TTFT
22.8 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · llama.cpp
Other
17 days ago
27.72 tok/s
Decode
124.12 tok/s
Prefill
1.55 s
TTFT
37.25 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · Ollama
Other
17 days ago
12 tok/s
Decode
64.43 tok/s
Prefill
1.25 s
TTFT
107 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · llama.cpp
Other
17 days ago
83.43 tok/s
Decode
309.76 tok/s
Prefill
0.15 s
TTFT
25.91 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · Ollama
Other
17 days ago
48.58 tok/s
Decode
245.06 tok/s
Prefill
0.78 s
TTFT
44.06 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
17 days ago
91.11 tok/s
Decode
454.84 tok/s
Prefill
1.45 s
TTFT
37.25 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
17 days ago
81.06 tok/s
Decode
387.21 tok/s
Prefill
1.78 s
TTFT
46.33 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · Ollama
Other
17 days ago
85.88 tok/s
Decode
388.53 tok/s
Prefill
0.99 s
TTFT
39.52 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · Ollama
Other
17 days ago
53.29 tok/s
Decode
218.93 tok/s
Prefill
2.01 s
TTFT
58.8 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H100 80GB HBM3 · 80GB · vLLM
Other
17 days ago
234.17 tok/s
Decode
755.94 tok/s
Prefill
1.52 s
TTFT
67.3 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H100 80GB HBM3 · 80GB · Strata
Other
17 days ago
335.33 tok/s
Decode
1,692.56 tok/s
Prefill
2.12 s
TTFT
38.96 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H100 80GB HBM3 · 80GB · Strata
Other
17 days ago
297.87 tok/s
Decode
1,046.41 tok/s
Prefill
2.1 s
TTFT
67.3 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · vLLM
Other
17 days ago
48.48 tok/s
Decode
199.47 tok/s
Prefill
1.89 s
TTFT
38.96 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · Ollama
Other
17 days ago
32.97 tok/s
Decode
115.23 tok/s
Prefill
2.19 s
TTFT
48.59 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX PRO 6000 Blackwell 96GB · 96GB · llama.cpp
Other
17 days ago
267.34 tok/s
Decode
934.02 tok/s
Prefill
1.04 s
TTFT
25.91 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
39 results