Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
AMD Ryzen AI Max+ 395 · 128GB · llama.cpp
Other
14 days ago
77.09 tok/s
Decode
382.38 tok/s
Prefill
0.6 s
TTFT
53.92 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · vLLM
Other
14 days ago
63.8 tok/s
Decode
213.74 tok/s
Prefill
2.31 s
TTFT
67.29 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · llama.cpp
Other
14 days ago
152.51 tok/s
Decode
687.68 tok/s
Prefill
2.15 s
TTFT
58.94 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · Ollama
Other
14 days ago
123.41 tok/s
Decode
650.98 tok/s
Prefill
1.96 s
TTFT
63.95 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · Ollama
Other
14 days ago
153.39 tok/s
Decode
803.06 tok/s
Prefill
2.16 s
TTFT
48.07 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
14 days ago
324.79 tok/s
Decode
1,453.99 tok/s
Prefill
1.3 s
TTFT
37.2 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
14 days ago
181.42 tok/s
Decode
831.96 tok/s
Prefill
2.15 s
TTFT
77.32 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · Ollama
Other
14 days ago
230.73 tok/s
Decode
1,077.9 tok/s
Prefill
0.4 s
TTFT
48.07 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H100 80GB HBM3 · 80GB · vLLM
Other
14 days ago
325.98 tok/s
Decode
1,095.54 tok/s
Prefill
2.24 s
TTFT
45.56 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · vLLM
Other
14 days ago
94.37 tok/s
Decode
330.77 tok/s
Prefill
1.13 s
TTFT
70.63 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · vLLM
Other
14 days ago
79.46 tok/s
Decode
372.23 tok/s
Prefill
1.4 s
TTFT
85.68 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA H20 · 97GB · Ollama
Other
14 days ago
104.76 tok/s
Decode
539.82 tok/s
Prefill
0.94 s
TTFT
56.43 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX PRO 6000 Blackwell 96GB · 96GB · vLLM
Other
14 days ago
327.3 tok/s
Decode
1,746.79 tok/s
Prefill
0.99 s
TTFT
62.28 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX PRO 6000 Blackwell 96GB · 96GB · Strata
Other
14 days ago
343.48 tok/s
Decode
1,507.36 tok/s
Prefill
0.53 s
TTFT
56.43 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M2 Ultra · llama.cpp
Other
14 days ago
159.13 tok/s
Decode
607.98 tok/s
Prefill
1.56 s
TTFT
76 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M2 Ultra · Ollama
Other
14 days ago
184.42 tok/s
Decode
830.52 tok/s
Prefill
1.07 s
TTFT
63.95 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · llama.cpp
Other
14 days ago
91.56 tok/s
Decode
457.14 tok/s
Prefill
0.25 s
TTFT
57.27 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · llama.cpp
Other
14 days ago
100.54 tok/s
Decode
475.16 tok/s
Prefill
0.19 s
TTFT
56.43 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · llama.cpp
Other
14 days ago
76.22 tok/s
Decode
300.34 tok/s
Prefill
2.21 s
TTFT
70.63 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX Spark · 128GB · Ollama
Other
14 days ago
74.46 tok/s
Decode
328.19 tok/s
Prefill
0.25 s
TTFT
63.95 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
22 results