NVIDIA RTX 5050
GPUNVIDIA Blackwell (GB207): 8 GB GDDR6 on a 128-bit bus, 320 GB/s of memory bandwidth, 130 W board power, $249 launch MSRP. An entry-level 8 GB card - capacity and bandwidth are both low, so local inference is mostly limited to small (<7B) quantized models.
2
Run records
1
Models covered
1
Frameworks covered
L0 Self-reported × 2
Evidence mix
Typical measured performance
Published benchmark averages per model × framework × quantization on this hardware.
- llama.cpp · Q5_K_M Decode 83.2 · Prefill 624 ·
- llama.cpp · Q4_K_M Decode 104 · Prefill 780 ·
Key specs
- Vendor
- NVIDIA
- Architecture
- Blackwell
- VRAM
- 8 GB
- Memory bandwidth
- 320 GB/s
- TDP
- 130 W
- Release date
- 2025-07-01
Run records
2 configurations
| Model | Framework | Quantization | Decode | Gen time | Samples |
|---|---|---|---|---|---|
| Qwen3.5-4B | llama.cpp | Q5_K_M | 83.2 tok/s | — | 1 |
| Qwen3.5-4B | llama.cpp | Q4_K_M | 104 tok/s | — | 1 |