Recursive's coding-agent MoE released 2026-10-21 (Apache-2.0): 39.8B total parameters, about 2.5B active per token (including the output head; the body alone is ~2.2B — the official size designation is 40B-A2.5B). Architecture: 49 layers (2 dense + 47 MoE), 256 routed experts with 6 selected per token plus an always-active shared expert; attention is 35 sliding-window layers (513-token window) plus 14 full-attention layers, RoPE on sliding-window layers and no positional encoding on full-attention ones, with per-head QK RMSNorm and attention sinks. 262,144-token context, 150,144 vocabulary, knowledge cutoff June 2026. Release evaluations: Terminal-Bench 2.1 54.9%, SWE-bench Pro v2 89.7%, SWE-bench Verified 74.2% (Recursive-measured, temperature 1.0, average pass@1 over at least five attempts). BF16 weights are about 80GB; community GGUFs (unsloth) run UD-Q4_K_XL at 25.1GB, Q8_0 at 42.3GB and UD-IQ1_M at 11.4GB. TechCrunch and WIRED report the model was largely built by AI in under four months.
0
Quantized builds
22
Benchmark records
1
Discussions
Quantized builds
Community and official quantized releases; "linked records" counts only benchmarks tied to that exact release.
No quantized builds cataloged yet.
Benchmark data
22 configurations
| Hardware | Framework | Quant | Decode | VRAM used | Samples | Evidence |
|---|---|---|---|---|---|---|
| AMD Ryzen AI Max+ 395 | llama.cpp | IQ3_XS | 77.1 tok/s | 53.92 GB | 1 | L2 Cross-framework verified |
| AMD Ryzen AI Max+ 395 | vLLM | Q4_K_S | 63.8 tok/s | 67.29 GB | 1 | L2 Cross-framework verified |
| Apple M5 Max | llama.cpp | Q3_K_M | 152.5 tok/s | 58.94 GB | 1 | L2 Cross-framework verified |
| Apple M5 Max | Ollama | IQ4_XS | 123.4 tok/s | 63.95 GB | 1 | L2 Cross-framework verified |
| Apple M5 Max | Ollama | Q2_K | 153.4 tok/s | 48.07 GB | 1 | L2 Cross-framework verified |
| Apple M5 Ultra | llama.cpp | IQ1_S | 324.8 tok/s | 37.2 GB | 1 | L2 Cross-framework verified |
| Apple M5 Ultra | llama.cpp | Q5_K_S | 181.4 tok/s | 77.32 GB | 1 | L2 Cross-framework verified |
| Apple M5 Ultra | Ollama | Q2_K | 230.7 tok/s | 48.07 GB | 1 | L2 Cross-framework verified |
| NVIDIA H100 80GB HBM3 | vLLM | IQ2_M | 326 tok/s | 45.56 GB | 1 | L2 Cross-framework verified |
| NVIDIA H20 | vLLM | Q4_K_M | 94.4 tok/s | 70.63 GB | 1 | L2 Cross-framework verified |
| NVIDIA H20 | vLLM | Q6_K | 79.5 tok/s | 85.68 GB | 1 | L2 Cross-framework verified |
| NVIDIA H20 | Ollama | Q3_K_S | 104.8 tok/s | 56.43 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX PRO 6000 Blackwell 96GB | vLLM | Q3_K_L | 327.3 tok/s | 62.28 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX PRO 6000 Blackwell 96GB | Strata | Q3_K_S | 343.5 tok/s | 56.43 GB | 1 | L2 Cross-framework verified |
| Apple M2 Ultra | llama.cpp | Q5_K_S | 159.1 tok/s | 76 GB | 1 | L2 Cross-framework verified |
| Apple M2 Ultra | Ollama | IQ4_XS | 184.4 tok/s | 63.95 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX Spark | llama.cpp | IQ3_S | 91.6 tok/s | 57.27 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX Spark | llama.cpp | Q3_K_S | 100.5 tok/s | 56.43 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX Spark | llama.cpp | Q4_K_M | 76.2 tok/s | 70.63 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX Spark | Ollama | IQ4_XS | 74.5 tok/s | 63.95 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX Spark | Ollama | Q2_K | 96.8 tok/s | 48.07 GB | 1 | L2 Cross-framework verified |
| NVIDIA RTX Spark | Ollama | Q4_K_M | 70 tok/s | 70.63 GB | 1 | L2 Cross-framework verified |
22 of these records are not linked to a specific quantized build; the full set is on the search page.