Mixed Precision Computing

Numerical Stability

Property of an algorithm to maintain calculation precision in the face of rounding errors and overflow/underflow, particularly critical in mixed precision where reduced dynamic range can destabilize certain calculations.

← Terug