DATEE: An Adaptively Thresholded Early-Exit Framework for Large Language Model Inference Based on Confidence Trend Sampling.

Haonan Zou, Heng Zhang, Yongchun Jiang, Kaifan Jia, Yansong Dong, Shang Wang, Zhihao Ling

Browse the full KSEM paper archive.