Benchmark search

Try these searches

Found 62 run configurations

Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.

ModelQwen3-Coder-Next

Qwen3-Coder-Next · IQ2_M

L2 Cross-framework verified

NVIDIA RTX 5090 · 32GB · Ollama

Other

2026-10-15

299.22 tok/s

Decode

1,242.06 tok/s

Prefill

1.78 s

TTFT

1.05 GB

VRAM

Config (latest run)
macOS 15.0 CUDA 12.8 IQ2_M Ollama v0.32 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q3_K_M

L2 Cross-framework verified

NVIDIA RTX 5090 · 32GB · Ollama

Other

2026-10-15

238.15 tok/s

Decode

870.24 tok/s

Prefill

0.86 s

TTFT

1.05 GB

VRAM

Config (latest run)
macOS 15.0 CUDA 12.4 Q3_K_M Ollama v0.36

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · IQ1_S

L2 Cross-framework verified

NVIDIA RTX 5090 · 32GB · Strata

Other

2026-10-15

320.16 tok/s

Decode

1,259.65 tok/s

Prefill

1.47 s

TTFT

1.05 GB

VRAM

Config (latest run)
macOS 15.0 CUDA 12.8 IQ1_S Strata v0.49

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q4_K_S

L2 Cross-framework verified

AMD Ryzen AI Max+ 395 · 128GB · llama.cpp

Other

2026-10-15

90.68 tok/s

Decode

349.79 tok/s

Prefill

0.68 s

TTFT

1.05 GB

VRAM

Config (latest run)
Windows 11 23H2 CUDA N/A Q4_K_S llama.cpp v0.20 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · IQ2_M

L2 Cross-framework verified

AMD Ryzen AI Max+ 395 · 128GB · Ollama

Other

2026-10-15

108.9 tok/s

Decode

355.25 tok/s

Prefill

1.29 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 24.04 CUDA N/A IQ2_M Ollama v0.30 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q3_K_S

L2 Cross-framework verified

AMD Ryzen AI Max+ 395 · 128GB · Ollama

Other

2026-10-15

98.59 tok/s

Decode

347.51 tok/s

Prefill

1.24 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA N/A Q3_K_S Ollama v0.29

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q5_K_S

L2 Cross-framework verified

Apple M5 Max · 128GB · llama.cpp

Other

2026-10-15

144.1 tok/s

Decode

764.74 tok/s

Prefill

1.83 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA 12.8 Q5_K_S llama.cpp v0.39 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q2_K

L2 Cross-framework verified

Apple M5 Max · 128GB · Strata

Other

2026-10-15

312.25 tok/s

Decode

1,150.01 tok/s

Prefill

2.2 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA 12.6 Q2_K Strata v0.30 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q3_K_L

L2 Cross-framework verified

NVIDIA DGX Spark · 128GB · Ollama

Other

2026-10-15

131.46 tok/s

Decode

705.73 tok/s

Prefill

1.45 s

TTFT

1.05 GB

VRAM

Config (latest run)
Windows 11 23H2 CUDA 12.6 Q3_K_L Ollama v0.45

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q4_K_S

L2 Cross-framework verified

NVIDIA DGX Spark · 128GB · Ollama

Other

2026-10-15

128.78 tok/s

Decode

450.1 tok/s

Prefill

0.98 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA 12.8 Q4_K_S Ollama v0.45 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · IQ2_M

L2 Cross-framework verified

NVIDIA DGX Spark · 128GB · Strata

Other

2026-10-15

261.64 tok/s

Decode

916.28 tok/s

Prefill

1.55 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 24.04 CUDA 12.4 IQ2_M Strata v0.25 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · IQ2_XS

L2 Cross-framework verified

NVIDIA DGX Spark · 128GB · Strata

Other

2026-10-15

259.54 tok/s

Decode

1,190.55 tok/s

Prefill

1.7 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 24.04 CUDA 12.8 IQ2_XS Strata v0.50 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q4_K_S

L2 Cross-framework verified

NVIDIA Jetson AGX Orin 64GB · 64GB · llama.cpp

Other

2026-10-15

56.6 tok/s

Decode

223.69 tok/s

Prefill

1.86 s

TTFT

1.05 GB

VRAM

Config (latest run)
JetPack 6.0 CUDA 12.6 Q4_K_S llama.cpp v0.27 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q3_K_M

L2 Cross-framework verified

NVIDIA Jetson AGX Orin 64GB · 64GB · Ollama

Other

2026-10-15

54.87 tok/s

Decode

250.05 tok/s

Prefill

0.45 s

TTFT

1.05 GB

VRAM

Config (latest run)
JetPack 6.0 CUDA 12.6 Q3_K_M Ollama v0.55 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q8_0

L2 Cross-framework verified

AMD Strix Halo (Radeon 8060S) · llama.cpp

Other

2026-10-15

46.29 tok/s

Decode

157.5 tok/s

Prefill

1.17 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA N/A Q8_0 llama.cpp v0.42 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q2_K

L2 Cross-framework verified

AMD Strix Halo (Radeon 8060S) · Ollama

Other

2026-10-15

85.26 tok/s

Decode

425.23 tok/s

Prefill

2.26 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 24.04 CUDA N/A Q2_K Ollama v0.25

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q3_K_S

L2 Cross-framework verified

2x AMD Strix Halo · vLLM

Other

2026-10-15

149.19 tok/s

Decode

617.1 tok/s

Prefill

1.16 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA N/A Q3_K_S vLLM v0.48

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q8_0

L2 Cross-framework verified

2x AMD Strix Halo · vLLM

Other

2026-10-15

87.69 tok/s

Decode

408.22 tok/s

Prefill

0.88 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA N/A Q8_0 vLLM v0.40 Flash Attention

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · Q3_K_M

L2 Cross-framework verified

2x AMD Strix Halo · Strata

Other

2026-10-15

208.39 tok/s

Decode

864.96 tok/s

Prefill

0.74 s

TTFT

1.05 GB

VRAM

Config (latest run)
macOS 15.0 CUDA N/A Q3_K_M Strata v0.32

Sources: Other · 1 runs · 1 independent sources

Qwen3-Coder-Next · IQ1_S

L2 Cross-framework verified

AMD Strix Point (Radeon 890M) · vLLM

Other

2026-10-15

79.93 tok/s

Decode

394.12 tok/s

Prefill

0.51 s

TTFT

1.05 GB

VRAM

Config (latest run)
Ubuntu 22.04 CUDA N/A IQ1_S vLLM v0.40 Flash Attention

Sources: Other · 1 runs · 1 independent sources

62 results

Related models
Related hardware
Related frameworks
Related quantizations