Speculative Prefill: Turbocharging TTFT with Lightweight and Training-Free Token Importance Estimation.

Jingyu Liu, Beidi Chen, Ce Zhang

Browse the full ICML paper archive.