Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
NVIDIA RTX Spark · 128GB · llama.cpp
Other
16 days ago
42.81 tok/s
Decode
164.71 tok/s
Prefill
2.94 s
TTFT
110.2 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · llama.cpp
Other
16 days ago
67.28 tok/s
Decode
348.21 tok/s
Prefill
2.42 s
TTFT
60.69 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · llama.cpp
Other
16 days ago
58.7 tok/s
Decode
210.79 tok/s
Prefill
1.41 s
TTFT
74.55 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · Ollama
Other
16 days ago
64.27 tok/s
Decode
274.24 tok/s
Prefill
2.89 s
TTFT
60.69 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · Ollama
Other
16 days ago
46.83 tok/s
Decode
233.52 tok/s
Prefill
0.58 s
TTFT
74.55 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · llama.cpp
Other
17 days ago
83.71 tok/s
Decode
315.21 tok/s
Prefill
1.37 s
TTFT
28.56 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · vLLM
Other
17 days ago
50.65 tok/s
Decode
184.14 tok/s
Prefill
0.35 s
TTFT
58.8 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · llama.cpp
Other
17 days ago
147.71 tok/s
Decode
746.12 tok/s
Prefill
0.53 s
TTFT
41.16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · llama.cpp
Other
17 days ago
134.94 tok/s
Decode
533.49 tok/s
Prefill
2.19 s
TTFT
44.94 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · Ollama
Other
17 days ago
139.95 tok/s
Decode
497.06 tok/s
Prefill
2.04 s
TTFT
32.34 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · Ollama
Other
17 days ago
63.92 tok/s
Decode
252.01 tok/s
Prefill
2.38 s
TTFT
74.55 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
17 days ago
216.9 tok/s
Decode
866.69 tok/s
Prefill
1.81 s
TTFT
34.86 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
17 days ago
189.37 tok/s
Decode
679.35 tok/s
Prefill
0.33 s
TTFT
43.05 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · Ollama
Other
17 days ago
139.67 tok/s
Decode
562.73 tok/s
Prefill
1.7 s
TTFT
58.8 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H100 80GB HBM3 · 80GB · llama.cpp
Other
17 days ago
289.84 tok/s
Decode
1,568.48 tok/s
Prefill
1.64 s
TTFT
65.1 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H100 80GB HBM3 · 80GB · vLLM
Other
17 days ago
346.16 tok/s
Decode
1,601.93 tok/s
Prefill
2.02 s
TTFT
32.34 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H100 80GB HBM3 · 80GB · vLLM
Other
17 days ago
299.81 tok/s
Decode
1,193.35 tok/s
Prefill
1.68 s
TTFT
60.69 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · llama.cpp
Other
17 days ago
57.59 tok/s
Decode
253.97 tok/s
Prefill
1.63 s
TTFT
65.1 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · Strata
Other
17 days ago
178.17 tok/s
Decode
571.19 tok/s
Prefill
2.45 s
TTFT
28.56 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · Strata
Other
17 days ago
139.08 tok/s
Decode
595.25 tok/s
Prefill
1.43 s
TTFT
41.16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
31 results