Communication and Network Optimization

Sparse Communication

Method consisting of transmitting only a fraction of model parameters or gradients, selected according to their importance, to drastically reduce communication volume.

← Zurück