Flint-40B-A2.5B

39.8BCodeby Recursive Start a discussion

Recursive's coding-agent MoE released 2026-10-21 (Apache-2.0): 39.8B total parameters, about 2.5B active per token (including the output head; the body alone is ~2.2B — the official size designation is 40B-A2.5B). Architecture: 49 layers (2 dense + 47 MoE), 256 routed experts with 6 selected per token plus an always-active shared expert; attention is 35 sliding-window layers (513-token window) plus 14 full-attention layers, RoPE on sliding-window layers and no positional encoding on full-attention ones, with per-head QK RMSNorm and attention sinks. 262,144-token context, 150,144 vocabulary, knowledge cutoff June 2026. Release evaluations: Terminal-Bench 2.1 54.9%, SWE-bench Pro v2 89.7%, SWE-bench Verified 74.2% (Recursive-measured, temperature 1.0, average pass@1 over at least five attempts). BF16 weights are about 80GB; community GGUFs (unsloth) run UD-Q4_K_XL at 25.1GB, Q8_0 at 42.3GB and UD-IQ1_M at 11.4GB. TechCrunch and WIRED report the model was largely built by AI in under four months.

0

Quantized builds

22

Benchmark records

1

Discussions

Quantized builds

Community and official quantized releases; "linked records" counts only benchmarks tied to that exact release.

No quantized builds cataloged yet.

Benchmark data

22 configurations

HardwareFrameworkQuantDecodeVRAM usedSamplesEvidence
AMD Ryzen AI Max+ 395llama.cppIQ3_XS77.1 tok/s53.92 GB1L2 Cross-framework verified
AMD Ryzen AI Max+ 395vLLMQ4_K_S63.8 tok/s67.29 GB1L2 Cross-framework verified
Apple M5 Maxllama.cppQ3_K_M152.5 tok/s58.94 GB1L2 Cross-framework verified
Apple M5 MaxOllamaIQ4_XS123.4 tok/s63.95 GB1L2 Cross-framework verified
Apple M5 MaxOllamaQ2_K153.4 tok/s48.07 GB1L2 Cross-framework verified
Apple M5 Ultrallama.cppIQ1_S324.8 tok/s37.2 GB1L2 Cross-framework verified
Apple M5 Ultrallama.cppQ5_K_S181.4 tok/s77.32 GB1L2 Cross-framework verified
Apple M5 UltraOllamaQ2_K230.7 tok/s48.07 GB1L2 Cross-framework verified
NVIDIA H100 80GB HBM3vLLMIQ2_M326 tok/s45.56 GB1L2 Cross-framework verified
NVIDIA H20vLLMQ4_K_M94.4 tok/s70.63 GB1L2 Cross-framework verified
NVIDIA H20vLLMQ6_K79.5 tok/s85.68 GB1L2 Cross-framework verified
NVIDIA H20OllamaQ3_K_S104.8 tok/s56.43 GB1L2 Cross-framework verified
NVIDIA RTX PRO 6000 Blackwell 96GBvLLMQ3_K_L327.3 tok/s62.28 GB1L2 Cross-framework verified
NVIDIA RTX PRO 6000 Blackwell 96GBStrataQ3_K_S343.5 tok/s56.43 GB1L2 Cross-framework verified
Apple M2 Ultrallama.cppQ5_K_S159.1 tok/s76 GB1L2 Cross-framework verified
Apple M2 UltraOllamaIQ4_XS184.4 tok/s63.95 GB1L2 Cross-framework verified
NVIDIA RTX Sparkllama.cppIQ3_S91.6 tok/s57.27 GB1L2 Cross-framework verified
NVIDIA RTX Sparkllama.cppQ3_K_S100.5 tok/s56.43 GB1L2 Cross-framework verified
NVIDIA RTX Sparkllama.cppQ4_K_M76.2 tok/s70.63 GB1L2 Cross-framework verified
NVIDIA RTX SparkOllamaIQ4_XS74.5 tok/s63.95 GB1L2 Cross-framework verified
NVIDIA RTX SparkOllamaQ2_K96.8 tok/s48.07 GB1L2 Cross-framework verified
NVIDIA RTX SparkOllamaQ4_K_M70 tok/s70.63 GB1L2 Cross-framework verified

22 of these records are not linked to a specific quantized build; the full set is on the search page.

Community discussion

View all discussions