Benchmark search

Try these searches

Found 1 run configurations

Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.

ModelQwen3-4B-Thinking-2507

Qwen3-4B-Thinking-2507 · Q8_0

L1 Reproduced

Qualcomm Snapdragon X Elite · llama.cpp

GitHub

Yesterday

18.5 tok/s

Decode

2.2 tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Windows Q8_0 llama.cpp b1-f027c4f

Sources: GitHub · 1 runs · 1 independent sources

1 results

Related models
Related hardware
Related frameworks
Related quantizations