Qwen3.5-4B · Q4_K_M
L1 ReproducedNVIDIA RTX 2060 · 6GB · llama.cpp
GitHub
Yesterday
56.1 tok/s
Decode
131 tok/s
Prefill
— s
TTFT
— GB
VRAM
Config (latest run)
Windows 11 Q4_K_M llama.cpp b11206
Sources: GitHub · 1 runs · 1 independent sources
Benchmark search
Try these searches
Found 1 run configurations
Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
ModelQwen3.5-4B
1 results
Related models
Related hardware
Related frameworks
Related quantizations