Few-bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction.
Georgii Sergeevich Novikov, Daniel Bershatsky, Julia Gusak, Alex Shonenkov, Denis Valerievich Dimitrov, Ivan V. Oseledets
Browse the full ICML paper archive.