Quantization of Large Language Models with an Overdetermined Basis.

Daniil Merkulov, Daria Cherniuk, Alexander Rudikov, Ivan V. Oseledets, Ekaterina A. Muravleva, Aleksandr Mikhalev, Boris Kashin

Browse the full UAI paper archive.