Mixed Precision Computing

Dynamic Range

Range of representable values between the smallest normalized number and the largest floating point number, critical in precision selection as FP16 has a limited dynamic range (65504) compared to FP32 (3.4×10³⁸).

← Back