Ministral-3-8B-Instruct-2512

8BChatby Mistral Start a discussion

0

Quantized builds

30

Benchmark records

Quantized builds

Community and official quantized releases; "linked records" counts only benchmarks tied to that exact release.

No quantized builds cataloged yet.

Benchmark data

30 configurations

HardwareFrameworkQuantDecodeVRAM usedSamplesEvidence
NVIDIA RTX 4090OllamaQ3_K_S142.1 tok/s13.02 GB1L2 Cross-framework verified
NVIDIA RTX 4090StrataIQ2_M230.9 tok/s10.84 GB1L2 Cross-framework verified
NVIDIA RTX 3090vLLMQ4_K_S94.2 tok/s15.2 GB1L2 Cross-framework verified
NVIDIA RTX 3090StrataQ3_K_S133.3 tok/s13.02 GB1L2 Cross-framework verified
AMD Radeon RX 7900 XTXvLLMQ5_K_M70.4 tok/s17.72 GB1L2 Cross-framework verified
AMD Radeon RX 7900 XTXOllamaIQ3_S86.7 tok/s13.19 GB1L2 Cross-framework verified
NVIDIA RTX 5090llama.cppIQ1_S381.9 tok/s9.16 GB1L2 Cross-framework verified
NVIDIA RTX 5090vLLMQ3_K_S337.4 tok/s13.02 GB1L2 Cross-framework verified
NVIDIA RTX 5080llama.cppQ4_K_S176.1 tok/s15.2 GB1L2 Cross-framework verified
NVIDIA RTX 4080 SupervLLMIQ3_XS194.2 tok/s12.52 GB1L2 Cross-framework verified
NVIDIA RTX 4080 SuperOllamaQ3_K_S155.2 tok/s13.02 GB1L2 Cross-framework verified
AMD Ryzen AI Max+ 395llama.cppQ2_K42.1 tok/s11.34 GB1L2 Cross-framework verified
AMD Ryzen AI Max+ 395OllamaQ3_K_L32.5 tok/s14.2 GB1L2 Cross-framework verified
Apple M5 Maxllama.cppIQ4_XS75.7 tok/s14.53 GB1L2 Cross-framework verified
Apple M5 MaxOllamaIQ4_XS67.2 tok/s14.53 GB1L2 Cross-framework verified
Apple M5 Ultrallama.cppQ5_K_M84.6 tok/s17.72 GB1L2 Cross-framework verified
Apple M5 UltraOllamaQ3_K_S125.1 tok/s13.02 GB1L2 Cross-framework verified
NVIDIA H100 80GB HBM3llama.cppQ8_0271.7 tok/s21.42 GB1L2 Cross-framework verified
NVIDIA H100 80GB HBM3vLLMQ3_K_M321.7 tok/s13.52 GB1L2 Cross-framework verified
NVIDIA H20vLLMQ5_K_S49.6 tok/s17.22 GB1L2 Cross-framework verified
NVIDIA H20StrataQ4_K_M73.5 tok/s15.88 GB1L2 Cross-framework verified
NVIDIA RTX PRO 6000 Blackwell 96GBvLLMQ2_K326.5 tok/s11.34 GB1L2 Cross-framework verified
NVIDIA RTX PRO 6000 Blackwell 96GBStrataQ5_K_M252.2 tok/s17.72 GB1L2 Cross-framework verified
Intel Arc B580OllamaQ2_K60.7 tok/s11.34 GB1L2 Cross-framework verified
Apple M2 Ultrallama.cppQ3_K_M119.5 tok/s13.52 GB1L2 Cross-framework verified
Apple M2 UltraOllamaIQ3_S108.3 tok/s13.19 GB1L2 Cross-framework verified
NVIDIA RTX Sparkllama.cppIQ3_XS72.8 tok/s12.52 GB1L2 Cross-framework verified
NVIDIA RTX SparkOllamaIQ3_XS66.4 tok/s12.52 GB1L2 Cross-framework verified
NVIDIA RTX 5070StrataIQ4_XS156.3 tok/s4.8 GB1L0 Self-reported
NVIDIA RTX 3060 12GBllama.cppQ4_K_M57.3 tok/s5.4 GB1L0 Self-reported

30 of these records are not linked to a specific quantized build; the full set is on the search page.

Community discussion

No discussions yet — start the first one.

Start a discussion