QFactory: Accelerating Quantized Large Language Model Serving with Qtile Graphs.

Qihao Zhang, Mingshu Zhai, Rui Sun, Jidong Zhai

Browse the full USENIX paper archive.