GLM-5.3

753.3BChatby Z.ai Start a discussion

Open-weight text-generation model from Z.ai, released 2026-08-25, 753.3B total, a bespoke open-weights licence. Z.ai's full GLM-5.3: ~753B total parameters with ~40B activated and 1M context, under the bespoke GLM-5.3 licence rather than MIT.

0

Quantized builds

26

Benchmark records

Quantized builds

Community and official quantized releases; "linked records" counts only benchmarks tied to that exact release.

No quantized builds cataloged yet.

Benchmark data

26 configurations

HardwareFrameworkQuantDecodeVRAM usedSamplesEvidence
NVIDIA RTX PRO 5000 BlackwellSGLangIQ2_XS4.3 tok/s48 GB1L0 Self-reported
NVIDIA RTX PRO 5000 BlackwellSGLangIQ3_S3.6 tok/s48 GB1L0 Self-reported
NVIDIA RTX PRO 5000 BlackwellvLLMIQ2_XS4.5 tok/s48 GB1L0 Self-reported
NVIDIA RTX PRO 5000 BlackwellvLLMIQ3_S3.7 tok/s48 GB1L0 Self-reported
NVIDIA DGX SparkSGLangIQ2_XS0.9 tok/s128 GB1L0 Self-reported
NVIDIA DGX SparkSGLangIQ3_S0.7 tok/s128 GB1L0 Self-reported
NVIDIA DGX SparkvLLMIQ2_XS0.9 tok/s128 GB1L0 Self-reported
NVIDIA DGX SparkvLLMIQ3_S0.8 tok/s128 GB1L0 Self-reported
2x NVIDIA RTX 5070 TiSGLangIQ2_XS—32 GB1L0 Self-reported
2x NVIDIA RTX 5070 TiSGLangIQ3_S—32 GB1L0 Self-reported
2x NVIDIA RTX 5070 TivLLMIQ2_XS—32 GB1L0 Self-reported
2x NVIDIA RTX 5070 TivLLMIQ3_S—32 GB1L0 Self-reported
Apple M5 Ultrallama.cppIQ2_XS3.7 tok/s254.7 GB1L0 Self-reported
Apple M5 Ultrallama.cppIQ3_S3.1 tok/s305.6 GB1L0 Self-reported
Apple M5 Prollama.cppIQ2_XS0.9 tok/s64 GB1L0 Self-reported
Apple M5 Prollama.cppIQ3_S0.8 tok/s64 GB1L0 Self-reported
Apple M4 Prollama.cppIQ2_XS0.8 tok/s64 GB1L0 Self-reported
Apple M4 Prollama.cppIQ3_S0.7 tok/s64 GB1L0 Self-reported
Apple M3 Maxllama.cppIQ2_XS0.9 tok/s36 GB1L0 Self-reported
Apple M3 Maxllama.cppIQ3_S0.8 tok/s36 GB1L0 Self-reported
NVIDIA RTX PRO 6000 BlackwellvLLMIQ3_S5 tok/s96 GB1L0 Self-reported
4x NVIDIA RTX 3090vLLMIQ2_XS—96 GB1L0 Self-reported
2x NVIDIA RTX 5090vLLMIQ3_S—64 GB1L0 Self-reported
Apple M5 Maxllama.cppIQ3_S1.6 tok/s128 GB1L0 Self-reported
NVIDIA RTX 5090vLLMIQ3_S5 tok/s32 GB1L0 Self-reported
NVIDIA RTX 4090vLLMIQ2_XS3.4 tok/s24 GB1L0 Self-reported

26 of these records are not linked to a specific quantized build; the full set is on the search page.

Community discussion

No discussions yet — start the first one.

Start a discussion