Community

Ask questions, share benchmark results, and swap deployment notes. Community posts are not verified by this site.

Start a discussion

1 topics

Showcase

DeepSeek-R1-Distill-Qwen-14B + RTX 4070 12GB + Q5_K_M：R1 推理能力下放到 12G 卡

Model · DeepSeek-R1-Distill-Qwen-14B Hardware · NVIDIA RTX 4070

新闻 #40 把 R1-Distill-14B 推上 12-16GB 卡甜区。我昨晚在 RTX 4070 12GB 上跑了一晚上，汇报。硬件： RTX 4070 12GB（不是 Ti，普通版） 64GB DDR5 NVMe 4.0 2TB

matrix_w21 days ago2 replies

matrix_w

21 days ago

2last reply 21 days ago

1 items