Fairness in Serving Large Language Models

TitleFairness in Serving Large Language Models
Publication TypeConference Paper
Year of Publication2024
AuthorsSheng Y, Cao S, Li D, Zhu B, Li Z, Zhuo D, Gonzalez JE, Stoica I
Conference Name18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24)
Date Published07/2024
PublisherUSENIX Association
Conference LocationSanta Clara, CA
ISBN Number978-1-939133-40-3
URLhttps://www.usenix.org/conference/osdi24/presentation/sheng