NVIDIA RTX 5090
GPUNVIDIA Blackwell flagship (GB202): 32 GB GDDR7 on a 512-bit bus, ~1.79 TB/s of memory bandwidth, 575 W board power.
2
Run records
2
Models covered
2
Frameworks covered
L0 Self-reported × 1 · L1 Reproduced × 1
Evidence mix
Typical measured performance
Published benchmark averages per model × framework × quantization on this hardware.
- llama.cpp · Q4_K_M Decode 30.09 · Prefill 1515.83 ·
- Nunchaku · NVFP4 rank-128 Decode — · Prefill — ·
Key specs
- Vendor
- NVIDIA
- Architecture
- Blackwell
- VRAM
- 32 GB
- Memory bandwidth
- 1792 GB/s
- TDP
- 575 W
- Release date
- 2025-01-30
Run records
2 configurations
| Model | Framework | Quantization | Decode | Gen time | Samples |
|---|---|---|---|---|---|
| Qwen3.5-27B | llama.cpp | Q4_K_M | 30.1 tok/s | — | 1 |
| Qwen-Image-2.1 | Nunchaku | NVFP4 rank-128 | — | 4.8 s | 1 |