Frameworks for Large Language Model Serving in HPC Environments.

Rohan Marwaha, Qinren Zhou, Kastan Day, Asmita Dabholkar, Volodymyr V. Kindratenko

Browse the full SC paper archive.