vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention.

Ramya Prabhu, Ajay Nayak, Jayashree Mohan, Ramachandran Ramjee, Ashish Panwar

Browse the full ASPLOS paper archive.