NVIDIAVendor documented
RTX 6000 Ada
Ada Lovelace · Ada · PCIe (workstation) · 2022
48 GB workstation GPU for development sandboxes, pro-viz, and desk-side inference before promoting workloads to the cluster.
GraphicsDev sandboxLLM inferenceVision
Precision fingerprint
6432t3216BF168i8
Memory
48 GB
GDDR6
Bandwidth
0.96 TB/s
peak
TDP
300 W
air
Max model
~13B
FP16, planning est.
Compute throughput
| FP64 | — |
| FP32 | 91.1 TFLOPS |
| TF32 | 91 TFLOPS |
| FP16 | 182 TFLOPS |
| BF16 | 182 TFLOPS |
| FP8 | 728 TFLOPS |
| INT8 | 728 TFLOPS |
Platform & software
InterconnectPCIe only
PCIePCIe 4.0 x16
Coolingair
MIGNot supported
VirtualizationvGPU
FrameworksCUDA, TensorRT, Omniverse
Availabilitybare-metal
Known limitations
- ·Workstation card — not designed for dense rack deployment
- ·No NVLink