AMDRequires validation
Instinct MI350X
CDNA 4 · CDNA 4 · OAM · 2025
CDNA 4 generation adding FP6/FP4 and 288 GB HBM3e. Figures here are preliminary and should be validated against final datasheets.
LLM trainingLLM inferenceMultimodalHPC
Precision fingerprint
6432t3216BF168i8
Memory
288 GB
HBM3e
Bandwidth
8 TB/s
peak
TDP
1400 W
liquid
Max model
~130B
FP16, planning est.
Compute throughput
| FP64 | 79 TFLOPS |
| FP32 | 158 TFLOPS |
| TF32 | — |
| FP16 | 2.30 PFLOPS |
| BF16 | 2.30 PFLOPS |
| FP8 | 4.60 PFLOPS |
| INT8 | 4.60 PFLOPS |
Platform & software
InterconnectInfinity Fabric
PCIePCIe 5.0 x16
Coolingliquid
MIGNot supported
PartitioningCompute + memory partitioning, SR-IOV
VirtualizationSR-IOV
FrameworksROCm, RCCL, vLLM (ROCm), MIOpen
Availabilitybare-metal
Known limitations
- ·Newly announced — public specs incomplete
- ·High TDP variants expect liquid cooling