Weight-based Analysis of Detokenization in Language Models: Understanding the First Stage of Inference Without Inference.

Go Kamoda, Benjamin Heinzerling, Tatsuro Inaba, Keito Kudo, Keisuke Sakaguchi, Kentaro Inui

Browse the full NAACL paper archive.