Model-Distributed Inference for Large Language Models at the Edge.

Davide Macario, Hulya Seferoglu, Erdem Koyuncu

Browse the full LANMAN paper archive.