NVIDIA RTX 3090 + NVIDIA RTX 3090 Ti

Desktop

Heterogeneous dual-GPU configuration, not a newly released GPU. Nominal VRAM is 24GB + 24GB, not a single contiguous pool or additive memory bandwidth. Source: https://github.com/noonghunna/club-3090/issues/1862 . The reported run caps power at 260W/240W and uses PCIe Gen4 x16/x4; these are run conditions, not rated TDP.

0

Run records

0

Models covered

0

Frameworks covered

Typical measured performance

Published benchmark averages per model × framework × quantization on this hardware.

No published benchmark data to compare yet.

Fit check

Physics-based estimate from VRAM and memory bandwidth: pick a model to see which quantizations fit and the expected speed

No indexed models available for this hardware

Formula: tok/s = (bandwidth ÷ model size) × 0.55, adapted from llmfit; see run records for measured numbers

Key specs

Vendor
NVIDIA
VRAM
48 GB

Run records

No published benchmark records yet — records are entered and source-tagged by the operators.