Tensor Cores Optimization

TensorFloat-32 (TF32)

NVIDIA hybrid numerical format using 8 exponent bits (like FP32) and 10 mantissa bits (like FP16), offering an optimal compromise between dynamic range and precision for Ampere Tensor Cores.

← Back