Authors:
Weijian Chen, Shuibing He, Haoyang Qu, Ruidong Zhang, Siling Yang, and Ping Chen, Zhejiang University; Yi Zheng and Baoxing Huai, Huawei Cloud; Gang Chen, Zhejiang University
IMPRESS: An Importance-informed Multi-tier Prefix KV Storage System for Large Language Model Inference