Arao AI

Benchmark search

Try these searches

Found 20 run configurations

Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.

ModelQwen3-Coder-Next

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 5070 SUPER · 18GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 5070 SUPER · 18GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 5070 SUPER · 18GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 5070 SUPER · 18GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 3090 · 24GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 3090 · 24GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 3090 · 24GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 3090 · 24GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 5070 · 12GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 5070 · 12GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 5070 · 12GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 5070 · 12GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 5090 · 32GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 5090 · 32GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 5090 · 32GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 5090 · 32GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 4090 · 24GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 4090 · 24GB · vLLM

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M vLLM 0.7.3 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q5_K_M

L0 Self-reported

NVIDIA RTX 4090 · 24GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q5_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

Qwen3-Coder-Next · Q4_K_M

L0 Self-reported

NVIDIA RTX 4090 · 24GB · llama.cpp

Other

Today

— tok/s

Decode

— tok/s

Prefill

— s

TTFT

— GB

VRAM

Config (latest run)
Linux CUDA 12.6 Q4_K_M llama.cpp b4200 Flash Attention

Sources: Other · 1 runs · 1 independent sources

View details

20 results

Related models
Related hardware
Related frameworks
Related quantizations