waLLMartCache: A Distributed, Multi-tenant and Enhanced Semantic Caching System for LLMs.

Soumik Dasgupta, Anurag Wagh, Lalitdutt Parsai, Binay Gupta, Geet Vudata, Shally Sangal, Sohom Majumdar, Hema Rajesh, Kunal Banerjee, Anirban Chatterjee

Browse the full ICPR paper archive.