GLM-5.3 · IQ2_XS
L0 Self-reportedNVIDIA RTX PRO 5000 Blackwell · 48GB · SGLang
Other
2026-10-06
4.3 tok/s
Decode
32.3 tok/s
Prefill
3.1 s
TTFT
48 GB
VRAM
Config (latest run)
Sources: Other · 1 runs · 1 independent sources
Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
NVIDIA RTX PRO 5000 Blackwell · 48GB · SGLang
Other
2026-10-06
4.3 tok/s
Decode
32.3 tok/s
Prefill
3.1 s
TTFT
48 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX PRO 5000 Blackwell · 48GB · SGLang
Other
2026-10-06
3.6 tok/s
Decode
27 tok/s
Prefill
3.7 s
TTFT
48 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX PRO 5000 Blackwell · 48GB · vLLM
Other
2026-10-06
4.5 tok/s
Decode
33.8 tok/s
Prefill
2.96 s
TTFT
48 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX PRO 5000 Blackwell · 48GB · vLLM
Other
2026-10-06
3.7 tok/s
Decode
27.8 tok/s
Prefill
3.6 s
TTFT
48 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · SGLang
Other
2026-10-06
0.9 tok/s
Decode
6.8 tok/s
Prefill
14.71 s
TTFT
128 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · SGLang
Other
2026-10-06
0.7 tok/s
Decode
5.3 tok/s
Prefill
18.87 s
TTFT
128 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · vLLM
Other
2026-10-06
0.9 tok/s
Decode
6.8 tok/s
Prefill
14.71 s
TTFT
128 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · vLLM
Other
2026-10-06
0.8 tok/s
Decode
6 tok/s
Prefill
16.67 s
TTFT
128 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x NVIDIA RTX 5070 Ti · 32GB · SGLang
Other
2026-10-06
— tok/s
Decode
— tok/s
Prefill
— s
TTFT
32 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x NVIDIA RTX 5070 Ti · 32GB · SGLang
Other
2026-10-06
— tok/s
Decode
— tok/s
Prefill
— s
TTFT
32 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x NVIDIA RTX 5070 Ti · 32GB · vLLM
Other
2026-10-06
— tok/s
Decode
— tok/s
Prefill
— s
TTFT
32 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x NVIDIA RTX 5070 Ti · 32GB · vLLM
Other
2026-10-06
— tok/s
Decode
— tok/s
Prefill
— s
TTFT
32 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
2026-10-06
3.7 tok/s
Decode
27.8 tok/s
Prefill
3.6 s
TTFT
254.7 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Ultra · 512GB · llama.cpp
Other
2026-10-06
3.1 tok/s
Decode
23.3 tok/s
Prefill
4.29 s
TTFT
305.6 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Pro · 64GB · llama.cpp
Other
2026-10-06
0.9 tok/s
Decode
6.8 tok/s
Prefill
14.71 s
TTFT
64 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Pro · 64GB · llama.cpp
Other
2026-10-06
0.8 tok/s
Decode
6 tok/s
Prefill
16.67 s
TTFT
64 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M4 Pro · 64GB · llama.cpp
Other
2026-10-06
0.8 tok/s
Decode
6 tok/s
Prefill
16.67 s
TTFT
64 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M4 Pro · 64GB · llama.cpp
Other
2026-10-06
0.7 tok/s
Decode
5.3 tok/s
Prefill
18.87 s
TTFT
64 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M3 Max · 36GB · llama.cpp
Other
2026-10-06
0.9 tok/s
Decode
6.8 tok/s
Prefill
14.71 s
TTFT
36 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M3 Max · 36GB · llama.cpp
Other
2026-10-06
0.8 tok/s
Decode
6 tok/s
Prefill
16.67 s
TTFT
36 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
26 results