Transformers Compression: A Study of Matrix Decomposition Methods Using Fisher Information.

Sergey Pletenev, Daniil Moskovskiy, Viktoria Chekalina, Mikhail Seleznyov, Sergey Zagoruyko, Alexander Panchenko

Browse the full AIST paper archive.