Optimization and Computational Efficiency

Memory Optimization by Gradient Checkpointing

Memory management technique that selectively saves intermediate activations during backpropagation, recalculating them as needed to trade reduced RAM usage for a slight increase in computation time.

← Wstecz