Open-weight text-generation model from Z.ai, released 2026-08-25, 753.3B total, a bespoke open-weights licence. Z.ai's full GLM-5.3: ~753B total parameters with ~40B activated and 1M context, under the bespoke GLM-5.3 licence rather than MIT.
0
Quantized builds
26
Benchmark records
Quantized builds
Community and official quantized releases; "linked records" counts only benchmarks tied to that exact release.
No quantized builds cataloged yet.
Benchmark data
26 configurations
| Hardware | Framework | Quant | Decode | VRAM used | Samples | Evidence |
|---|---|---|---|---|---|---|
| NVIDIA RTX PRO 5000 Blackwell | SGLang | IQ2_XS | 4.3 tok/s | 48 GB | 1 | L0 Self-reported |
| NVIDIA RTX PRO 5000 Blackwell | SGLang | IQ3_S | 3.6 tok/s | 48 GB | 1 | L0 Self-reported |
| NVIDIA RTX PRO 5000 Blackwell | vLLM | IQ2_XS | 4.5 tok/s | 48 GB | 1 | L0 Self-reported |
| NVIDIA RTX PRO 5000 Blackwell | vLLM | IQ3_S | 3.7 tok/s | 48 GB | 1 | L0 Self-reported |
| NVIDIA DGX Spark | SGLang | IQ2_XS | 0.9 tok/s | 128 GB | 1 | L0 Self-reported |
| NVIDIA DGX Spark | SGLang | IQ3_S | 0.7 tok/s | 128 GB | 1 | L0 Self-reported |
| NVIDIA DGX Spark | vLLM | IQ2_XS | 0.9 tok/s | 128 GB | 1 | L0 Self-reported |
| NVIDIA DGX Spark | vLLM | IQ3_S | 0.8 tok/s | 128 GB | 1 | L0 Self-reported |
| 2x NVIDIA RTX 5070 Ti | SGLang | IQ2_XS | — | 32 GB | 1 | L0 Self-reported |
| 2x NVIDIA RTX 5070 Ti | SGLang | IQ3_S | — | 32 GB | 1 | L0 Self-reported |
| 2x NVIDIA RTX 5070 Ti | vLLM | IQ2_XS | — | 32 GB | 1 | L0 Self-reported |
| 2x NVIDIA RTX 5070 Ti | vLLM | IQ3_S | — | 32 GB | 1 | L0 Self-reported |
| Apple M5 Ultra | llama.cpp | IQ2_XS | 3.7 tok/s | 254.7 GB | 1 | L0 Self-reported |
| Apple M5 Ultra | llama.cpp | IQ3_S | 3.1 tok/s | 305.6 GB | 1 | L0 Self-reported |
| Apple M5 Pro | llama.cpp | IQ2_XS | 0.9 tok/s | 64 GB | 1 | L0 Self-reported |
| Apple M5 Pro | llama.cpp | IQ3_S | 0.8 tok/s | 64 GB | 1 | L0 Self-reported |
| Apple M4 Pro | llama.cpp | IQ2_XS | 0.8 tok/s | 64 GB | 1 | L0 Self-reported |
| Apple M4 Pro | llama.cpp | IQ3_S | 0.7 tok/s | 64 GB | 1 | L0 Self-reported |
| Apple M3 Max | llama.cpp | IQ2_XS | 0.9 tok/s | 36 GB | 1 | L0 Self-reported |
| Apple M3 Max | llama.cpp | IQ3_S | 0.8 tok/s | 36 GB | 1 | L0 Self-reported |
| NVIDIA RTX PRO 6000 Blackwell | vLLM | IQ3_S | 5 tok/s | 96 GB | 1 | L0 Self-reported |
| 4x NVIDIA RTX 3090 | vLLM | IQ2_XS | — | 96 GB | 1 | L0 Self-reported |
| 2x NVIDIA RTX 5090 | vLLM | IQ3_S | — | 64 GB | 1 | L0 Self-reported |
| Apple M5 Max | llama.cpp | IQ3_S | 1.6 tok/s | 128 GB | 1 | L0 Self-reported |
| NVIDIA RTX 5090 | vLLM | IQ3_S | 5 tok/s | 32 GB | 1 | L0 Self-reported |
| NVIDIA RTX 4090 | vLLM | IQ2_XS | 3.4 tok/s | 24 GB | 1 | L0 Self-reported |
26 of these records are not linked to a specific quantized build; the full set is on the search page.
Community discussion
No discussions yet — start the first one.
Start a discussion