NVIDIA RTX 5060 Ti 16GB

GPU

NVIDIA Blackwell (GB206): 16 GB GDDR7 on a 128-bit bus, 448 GB/s of memory bandwidth, 180 W board power. The narrow bus caps bandwidth, but 16 GB is generous for the class.

2

Run records

2

Models covered

2

Frameworks covered

L0 Self-reported × 1 · L1 Reproduced × 1

Evidence mix

Typical measured performance

Published benchmark averages per model × framework × quantization on this hardware.

  1. llama.cpp · PTQ1_0 Decode 8.1 · Prefill 21.87 ·
  2. ComfyUI · INT8 ConvRot Decode — · Prefill — ·

Fit check

Physics-based estimate from VRAM and memory bandwidth: pick a model to see which quantizations fit and the expected speed

Formula: tok/s = (bandwidth ÷ model size) × 0.55, adapted from llmfit; see run records for measured numbers

Key specs

Vendor
NVIDIA
Architecture
Blackwell
VRAM
16 GB
Memory bandwidth
448 GB/s
TDP
180 W
Release date
2025-04-16

Run records

2 configurations

ModelFrameworkQuantizationDecodeGen timeSamples
Ternary Bonsai 2 27Bllama.cppPTQ1_08.1 tok/s—1
Qwen-Image-2.1ComfyUIINT8 ConvRot—18.5 s1