NVIDIA RTX 5060 Ti 16GB

GPU

NVIDIA Blackwell (GB206): 16 GB GDDR7 on a 128-bit bus, 448 GB/s of memory bandwidth, 180 W board power. The narrow bus caps bandwidth, but 16 GB is generous for the class.

2

Run records

2

Models covered

2

Frameworks covered

L0 Self-reported × 1 · L1 Reproduced × 1

Evidence mix

Typical measured performance

Published benchmark averages per model × framework × quantization on this hardware.

  1. llama.cpp · PTQ1_0 Decode 8.1 · Prefill 21.87 ·
  2. ComfyUI · INT8 ConvRot Decode — · Prefill — ·

Key specs

Vendor
NVIDIA
Architecture
Blackwell
VRAM
16 GB
Memory bandwidth
448 GB/s
TDP
180 W
Release date
2025-04-16

Run records

2 configurations

ModelFrameworkQuantizationDecodeGen timeSamples
Ternary Bonsai 2 27Bllama.cppPTQ1_08.1 tok/s—1
Qwen-Image-2.1ComfyUIINT8 ConvRot—18.5 s1