Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
NVIDIA RTX 5080 SUPER · 24GB · vLLM
Other
Today
29.4 tok/s
Decode
220.5 tok/s
Prefill
0.45 s
TTFT
24 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5080 SUPER · 24GB · vLLM
Other
Today
42.7 tok/s
Decode
320.3 tok/s
Prefill
0.31 s
TTFT
22.8 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5080 SUPER · 24GB · vLLM
Other
Today
52.3 tok/s
Decode
392.3 tok/s
Prefill
0.25 s
TTFT
18.7 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5080 SUPER · 24GB · llama.cpp
Other
Today
27 tok/s
Decode
202.5 tok/s
Prefill
0.49 s
TTFT
24 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5080 SUPER · 24GB · llama.cpp
Other
Today
39.2 tok/s
Decode
294 tok/s
Prefill
0.34 s
TTFT
22.8 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5080 SUPER · 24GB · llama.cpp
Other
Today
48 tok/s
Decode
360 tok/s
Prefill
0.28 s
TTFT
18.7 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 SUPER · 18GB · vLLM
Other
Today
23.5 tok/s
Decode
176.3 tok/s
Prefill
0.57 s
TTFT
18 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 SUPER · 18GB · vLLM
Other
Today
34.2 tok/s
Decode
256.5 tok/s
Prefill
0.39 s
TTFT
18 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 SUPER · 18GB · vLLM
Other
Today
41.8 tok/s
Decode
313.5 tok/s
Prefill
0.32 s
TTFT
18 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 SUPER · 18GB · llama.cpp
Other
Today
21.6 tok/s
Decode
162 tok/s
Prefill
0.62 s
TTFT
18 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 SUPER · 18GB · llama.cpp
Other
Today
31.3 tok/s
Decode
234.8 tok/s
Prefill
0.43 s
TTFT
18 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 SUPER · 18GB · llama.cpp
Other
Today
38.4 tok/s
Decode
288 tok/s
Prefill
0.35 s
TTFT
18 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 Ti · 16GB · vLLM
Other
Today
23.5 tok/s
Decode
176.3 tok/s
Prefill
0.57 s
TTFT
16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 Ti · 16GB · vLLM
Other
Today
34.2 tok/s
Decode
256.5 tok/s
Prefill
0.39 s
TTFT
16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 Ti · 16GB · vLLM
Other
Today
41.8 tok/s
Decode
313.5 tok/s
Prefill
0.32 s
TTFT
16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 Ti · 16GB · llama.cpp
Other
Today
21.6 tok/s
Decode
162 tok/s
Prefill
0.62 s
TTFT
16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 Ti · 16GB · llama.cpp
Other
Today
31.3 tok/s
Decode
234.8 tok/s
Prefill
0.43 s
TTFT
16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5070 Ti · 16GB · llama.cpp
Other
Today
38.4 tok/s
Decode
288 tok/s
Prefill
0.35 s
TTFT
16 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5090 · 32GB · vLLM
Other
Today
47 tok/s
Decode
352.5 tok/s
Prefill
0.28 s
TTFT
32 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5090 · 32GB · vLLM
Other
Today
68.3 tok/s
Decode
512.3 tok/s
Prefill
0.2 s
TTFT
22.8 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
30 results