Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information.

Yao Chen, Jiawei Sheng, Wenyuan Zhang, Tingwen Liu

Browse the full EMNLP paper archive.