NVIDIA RTX 2060

GPU

1

Run records

1

Models covered

1

Frameworks covered

L1 Reproduced × 1

Evidence mix

Typical measured performance

Published benchmark averages per model × framework × quantization on this hardware.

  1. llama.cpp · Q4_K_M Decode 56.1 · Prefill 131 ·

Fit check

Physics-based estimate from VRAM and memory bandwidth: pick a model to see which quantizations fit and the expected speed

Formula: tok/s = (bandwidth ÷ model size) × 0.55, adapted from llmfit; see run records for measured numbers

Key specs

Vendor
NVIDIA
VRAM
6 GB
Memory bandwidth
336 GB/s

Run records

1 configurations

ModelFrameworkQuantizationDecodeGen timeSamples
Qwen3.5-4Bllama.cppQ4_K_M56.1 tok/s—1