NVIDIA RTX 5090 Laptop

GPU

1

Run records

1

Models covered

1

Frameworks covered

L1 Reproduced × 1

Evidence mix

Typical measured performance

Published benchmark averages per model × framework × quantization on this hardware.

  1. llama.cpp · NVFP4 Decode 77.1 · Prefill 32.7 ·

Fit check

Physics-based estimate from VRAM and memory bandwidth: pick a model to see which quantizations fit and the expected speed

Formula: tok/s = (bandwidth ÷ model size) × 0.55, adapted from llmfit; see run records for measured numbers

Key specs

Vendor
NVIDIA
VRAM
24 GB
Memory bandwidth
896 GB/s

Run records

1 configurations

ModelFrameworkQuantizationDecodeGen timeSamples
Qwen3.8-27Bllama.cppNVFP477.1 tok/s—1