gemma-4-E2B-it · Q3_K_L
L2 Cross-framework verifiedNVIDIA RTX 5090 · 32GB · llama.cpp
Other
2026-10-15
324.42 tok/s
Decode
1,387.31 tok/s
Prefill
0.22 s
TTFT
5.12 GB
VRAM
Config (latest run)
Sources: Other · 1 runs · 1 independent sources
Each row is a run configuration (model + hardware + framework + quantization); repeated runs of the same setup are merged — raw counts appear in each result’s source line.
NVIDIA RTX 5090 · 32GB · llama.cpp
Other
2026-10-15
324.42 tok/s
Decode
1,387.31 tok/s
Prefill
0.22 s
TTFT
5.12 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA RTX 5090 · 32GB · Strata
Other
2026-10-15
332.29 tok/s
Decode
1,223.54 tok/s
Prefill
2.29 s
TTFT
4.87 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · llama.cpp
Other
2026-10-15
208.76 tok/s
Decode
678.14 tok/s
Prefill
1.53 s
TTFT
4.96 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Ryzen AI Max+ 395 · 128GB · vLLM
Other
2026-10-15
291.55 tok/s
Decode
1,102.46 tok/s
Prefill
1.52 s
TTFT
3.86 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · vLLM
Other
2026-10-15
285.33 tok/s
Decode
927.76 tok/s
Prefill
0.72 s
TTFT
4.96 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · Strata
Other
2026-10-15
329.61 tok/s
Decode
1,762.01 tok/s
Prefill
0.67 s
TTFT
5.12 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
Apple M5 Max · 128GB · Strata
Other
2026-10-15
323.09 tok/s
Decode
1,252.89 tok/s
Prefill
0.17 s
TTFT
6.93 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · vLLM
Other
2026-10-15
380.91 tok/s
Decode
2,066.12 tok/s
Prefill
0.4 s
TTFT
4.28 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · vLLM
Other
2026-10-15
360.01 tok/s
Decode
1,436.84 tok/s
Prefill
1.75 s
TTFT
4.7 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · Strata
Other
2026-10-15
389.31 tok/s
Decode
1,363.67 tok/s
Prefill
1.89 s
TTFT
5.12 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA DGX Spark · 128GB · Strata
Other
2026-10-15
326.71 tok/s
Decode
1,358.52 tok/s
Prefill
1.15 s
TTFT
5.54 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA Jetson AGX Orin 64GB · 64GB · Ollama
Other
2026-10-15
70.66 tok/s
Decode
305.15 tok/s
Prefill
1.82 s
TTFT
6.3 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA Jetson AGX Orin 64GB · 64GB · Strata
Other
2026-10-15
176.21 tok/s
Decode
663.99 tok/s
Prefill
0.99 s
TTFT
4.28 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
NVIDIA Jetson AGX Orin 64GB · 64GB · Strata
Other
2026-10-15
167.92 tok/s
Decode
544.11 tok/s
Prefill
1.65 s
TTFT
4.87 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Halo (Radeon 8060S) · Ollama
Other
2026-10-15
70.57 tok/s
Decode
330.84 tok/s
Prefill
0.96 s
TTFT
9.87 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Halo (Radeon 8060S) · Strata
Other
2026-10-15
228.54 tok/s
Decode
966.84 tok/s
Prefill
0.85 s
TTFT
4.83 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Halo (Radeon 8060S) · Strata
Other
2026-10-15
157.75 tok/s
Decode
603.58 tok/s
Prefill
1.61 s
TTFT
6.3 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x AMD Strix Halo · vLLM
Other
2026-10-15
277.77 tok/s
Decode
1,024.78 tok/s
Prefill
2.05 s
TTFT
4.83 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
2x AMD Strix Halo · Strata
Other
2026-10-15
321.59 tok/s
Decode
1,311.64 tok/s
Prefill
2.09 s
TTFT
4.7 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
AMD Strix Point (Radeon 890M) · llama.cpp
Other
2026-10-15
145.7 tok/s
Decode
692.08 tok/s
Prefill
1.45 s
TTFT
3.86 GB
VRAM
Sources: Other · 1 runs · 1 independent sources
53 results