Muse-Glimmer-30B

30BChat Start a discussion

0

Quantized builds

12

Benchmark records

Quantized builds

Community and official quantized releases; "linked records" counts only benchmarks tied to that exact release.

No quantized builds cataloged yet.

Benchmark data

12 configurations

HardwareFrameworkQuantDecodeVRAM usedSamplesEvidence
NVIDIA RTX 5070 TivLLMIQ2_XS75.4 tok/s10.6 GB1L0 Self-reported
NVIDIA RTX 5070 TivLLMQ4_K_M41.8 tok/s16 GB1L0 Self-reported
NVIDIA RTX 5070 Tillama.cppIQ2_XS69.2 tok/s10.6 GB1L0 Self-reported
NVIDIA RTX 5070 Tillama.cppQ4_K_M38.4 tok/s16 GB1L0 Self-reported
NVIDIA RTX 5090vLLMIQ2_XS150.8 tok/s10.6 GB1L0 Self-reported
NVIDIA RTX 5090vLLMQ4_K_M83.7 tok/s18.7 GB1L0 Self-reported
NVIDIA RTX 5090llama.cppIQ2_XS138.4 tok/s10.6 GB1L0 Self-reported
NVIDIA RTX 5090llama.cppQ4_K_M76.8 tok/s18.7 GB1L0 Self-reported
NVIDIA RTX 4090vLLMIQ2_XS84.8 tok/s10.6 GB1L0 Self-reported
NVIDIA RTX 4090vLLMQ4_K_M47.1 tok/s18.7 GB1L0 Self-reported
NVIDIA RTX 4090llama.cppIQ2_XS77.8 tok/s10.6 GB1L0 Self-reported
NVIDIA RTX 4090llama.cppQ4_K_M43.2 tok/s18.7 GB1L0 Self-reported

12 of these records are not linked to a specific quantized build; the full set is on the search page.

Community discussion

No discussions yet — start the first one.

Start a discussion