NVIDIA RTX 3080
GPUAmpere; 10GB VRAM, 760 GB/s bandwidth, 320W TDP, CUDA cores 8,704. Release date: 2020-09-17. Source: LCZ hardware catalog, with missing fields supplemented from NVIDIA official materials.
1
Run records
1
Models covered
1
Frameworks covered
L0 Self-reported × 1
Evidence mix
Typical measured performance
Published benchmark averages per model × framework × quantization on this hardware.
- llama.cpp · PTQ1_0 Decode 52.18 · Prefill 1210.6 ·
Key specs
- Vendor
- NVIDIA
- Architecture
- Ampere
- VRAM
- 10 GB
- Memory bandwidth
- 760 GB/s
- TDP
- 320 W
- Release date
- 2020-09-17
Run records
1 configurations
| Model | Framework | Quantization | Decode | Gen time | Samples |
|---|---|---|---|---|---|
| Ternary Bonsai 2 27B | llama.cpp | PTQ1_0 | 52.2 tok/s | — | 1 |