Kimi-K3

2800BChatby Moonshot Start a discussion

0

Quantized builds

56

Benchmark records

1

Discussions

Quantized builds

Community and official quantized releases; "linked records" counts only benchmarks tied to that exact release.

No quantized builds cataloged yet.

Benchmark data

50 configurations

HardwareFrameworkQuantDecodeVRAM usedSamplesEvidence
NVIDIA RTX 4090llama.cppIQ4_XS123.9 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4090OllamaQ3_K_L113.9 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4090OllamaQ8_070.6 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 3090llama.cppQ4_K_M61.2 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 3090OllamaQ5_K_M54 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4060 Ti 16GBvLLMQ5_K_S82.8 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4060 Ti 16GBOllamaIQ3_XS90.7 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4060 Ti 16GBOllamaIQ4_XS88 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 7900 XTXllama.cppIQ1_S109.8 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 7900 XTXllama.cppQ3_K_L75 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 7900 XTXOllamaQ5_K_S56.9 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5090vLLMQ3_K_L253.5 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5090vLLMQ4_K_S223.8 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5090StrataIQ3_S330.4 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5080OllamaQ5_K_S124.2 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5080OllamaQ8_085.1 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5080StrataQ8_0128.7 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 3060 12GBllama.cppQ3_K_L55.9 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 3060 12GBllama.cppQ3_K_M58.9 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 3060 12GBvLLMIQ4_XS53.1 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 9070 XTllama.cppIQ3_XS119 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 9070 XTllama.cppQ5_K_M84.7 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 9070 XTvLLMIQ4_XS107.1 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5070 TivLLMIQ1_S131.3 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5070 TivLLMIQ3_S95.4 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5070 TiStrataIQ3_S132.6 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5070 TiStrataQ3_K_S129.1 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5070vLLMQ3_K_L76.5 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5070StrataQ5_K_M76.5 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4080 Superllama.cppIQ2_XS184.9 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4080 SuperStrataIQ1_S255.3 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 9070vLLMIQ4_XS102.6 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 9070vLLMQ3_K_M122.1 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 9070OllamaIQ3_XS117.3 tok/s1.05 GB1L2 Cross-framework verified
AMD Radeon RX 9070OllamaQ2_K125.3 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4080OllamaIQ3_XS139.1 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4080OllamaQ5_K_M91.5 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4080StrataFP1679.7 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4080StrataQ4_K_M165.8 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4070 Tillama.cppQ4_K_M95.6 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 4070 TiOllamaQ3_K_S101.2 tok/s1.05 GB1L2 Cross-framework verified
Intel Arc B580llama.cppIQ3_S47 tok/s1.05 GB1L2 Cross-framework verified
Intel Arc B580llama.cppQ3_K_L43.5 tok/s1.05 GB1L2 Cross-framework verified
Intel Arc B580StrataIQ2_XS79 tok/s1.05 GB1L2 Cross-framework verified
NVIDIA RTX 5070SGLangQ5_K_M——1L0 Self-reported
NVIDIA RTX 5070SGLangQ4_K_M——1L0 Self-reported
NVIDIA RTX 5070vLLMQ5_K_M——1L0 Self-reported
NVIDIA RTX 5070vLLMQ4_K_M——1L0 Self-reported
NVIDIA RTX 5090SGLangQ5_K_M——1L0 Self-reported
NVIDIA RTX 5090SGLangQ4_K_M——1L0 Self-reported

56 of these records are not linked to a specific quantized build; the full set is on the search page.

Community discussion

View all discussions