NVIDIA GTX 1080 Ti
GPU3
Run records
2
Models covered
1
Frameworks covered
L0 Self-reported × 3
Evidence mix
Typical measured performance
Published benchmark averages per model × framework × quantization on this hardware.
No published records for this metric under the same model + hardware yet
Fit check
Physics-based estimate from VRAM and memory bandwidth: pick a model to see which quantizations fit and the expected speed
Formula: tok/s = (bandwidth ÷ model size) × 0.55, adapted from llmfit; see run records for measured numbers
Key specs
- Vendor
- NVIDIA
- VRAM
- 11 GB
- Memory bandwidth
- 484 GB/s
Run records
3 configurations
| Model | Framework | Quantization | Decode | Gen time | Samples |
|---|---|---|---|---|---|
| Qwen3.5-0.8B | llama.cpp | Q4_K_M | — | — | 1 |
| Qwen3.5-4B | llama.cpp | Q5_K_M | — | — | 1 |
| Qwen3.5-4B | llama.cpp | Q4_K_M | — | — | 1 |