Arao AI

safetensors FP8

A quantized build of the model Qwen3.8-27B.

Publisher
Qwen (Alibaba)
Source platform
HUGGINGFACE
Quantization
FP8
Revision
017b9c7af6b5689d5dd426a76e0bc077eb5ca20a
Updated
2026-09-26
Total size
28.3 GB
Download at sourceLicense text Start a discussion

File list

Paths and sizes come from the release page; a missing size shows "not provided".

File pathSize
layers-0.safetensors366.1 MB
layers-1.safetensors366.1 MB
layers-10.safetensors366.1 MB
layers-11.safetensors355.1 MB
layers-12.safetensors366.1 MB
layers-13.safetensors366.1 MB
layers-14.safetensors366.1 MB
layers-15.safetensors355.1 MB
layers-16.safetensors366.1 MB
layers-17.safetensors366.1 MB
layers-18.safetensors366.1 MB
layers-19.safetensors355.1 MB
layers-2.safetensors366.1 MB
layers-20.safetensors366.1 MB
layers-21.safetensors366.1 MB
layers-22.safetensors366.1 MB
layers-23.safetensors355.1 MB
layers-24.safetensors366.1 MB
layers-25.safetensors366.1 MB
layers-26.safetensors366.1 MB
layers-27.safetensors355.1 MB
layers-28.safetensors366.1 MB
layers-29.safetensors366.1 MB
layers-3.safetensors355.1 MB
layers-30.safetensors366.1 MB
layers-31.safetensors355.1 MB
layers-32.safetensors366.1 MB
layers-33.safetensors366.1 MB
layers-34.safetensors366.1 MB
layers-35.safetensors355.1 MB
layers-36.safetensors366.1 MB
layers-37.safetensors366.1 MB
layers-38.safetensors366.1 MB
layers-39.safetensors355.1 MB
layers-4.safetensors366.1 MB
layers-40.safetensors366.1 MB
layers-41.safetensors366.1 MB
layers-42.safetensors366.1 MB
layers-43.safetensors355.1 MB
layers-44.safetensors366.1 MB
layers-45.safetensors366.1 MB
layers-46.safetensors366.1 MB
layers-47.safetensors355.1 MB
layers-48.safetensors366.1 MB
layers-49.safetensors366.1 MB
layers-5.safetensors366.1 MB
layers-50.safetensors366.1 MB
layers-51.safetensors355.1 MB
layers-52.safetensors366.1 MB
layers-53.safetensors366.1 MB
layers-54.safetensors366.1 MB
layers-55.safetensors355.1 MB
layers-56.safetensors366.1 MB
layers-57.safetensors366.1 MB
layers-58.safetensors366.1 MB
layers-59.safetensors355.1 MB
layers-6.safetensors366.1 MB
layers-60.safetensors366.1 MB
layers-61.safetensors366.1 MB
layers-62.safetensors366.1 MB
layers-63.safetensors355.1 MB
layers-7.safetensors355.1 MB
layers-8.safetensors366.1 MB
layers-9.safetensors366.1 MB
outside.safetensors5.59 GB

Linked benchmarks

Only benchmarks tied to this exact release are listed.

HardwareFrameworkQuantDecodeVRAM usedSamplesEvidence
NVIDIA RTX PRO 5000 BlackwellSGLangFP831.5 tok/s43.2 GB1L0 Self-reported

Deployment guidance

This site doesn't guess whether or how this build runs on your machine. General local-deployment tutorials are linked below; if a link or data on this page is wrong, please tell us.

View deployment tutorials →Report a broken link