Skip to content

FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference.

Chenqi Lin, Tianshi Xu, Zebin Yang, Runsheng Wang, Ru Huang, Meng Li

VenueA*DAC
Year2024
ProceedingsDAC

Browse the full DAC paper archive.