Orca: A Distributed Serving System for Transformer-Based Generative Models.

Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, Byung-Gon Chun

Browse the full OSDI paper archive.