Mixed Precision Computing

TF32 (TensorFloat-32)

NVIDIA's proprietary 19-bit hybrid format combining 8-bit exponent from FP16 and 10-bit mantissa from FP32, optimized for matrix operations on Ampere and Hopper GPU Tensor Cores.

← Back