Community

Ask questions, share benchmark results, and swap deployment notes. Community posts are not verified by this site.

Start a discussion

1 topics

ShowcaseVerified

RTX 3080 10G 跑 27B 模型？Ternary Bonsai 2 三进制 PTQ1_0 只要 7G 显存

Model · Ternary Bonsai 2 27B Hardware · NVIDIA RTX 3080 Ti Benchmark · Ternary Bonsai 2 27B × NVIDIA RTX 3080

给老卡党们汇报一个邪道玩法：Ternary Bonsai 2 27B 是个三进制（ternary）模型，权重只有 {-1, 0, +1}，配合 PTQ1_0 打包，整模 7.03G 显存，我的老 3080 10G 全 offload 还剩

江南卡皇6 days ago2 replies

江南卡皇

6 days ago

2last reply 6 days ago

1 items