Machine Learning at Scale

AllReduce

Collective communication algorithm enabling synchronized reduction and broadcasting of gradients between all nodes in a distributed training environment.

← Quay lại