ParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage

Authors: 

Xiaolu Li, Huazhong University of Science and Technology; Keyun Cheng, Kaicheng Tang, and Patrick P. C. Lee, The Chinese University of Hong Kong; Yuchong Hu, Huazhong University of Science and Technology; Dan Feng, Huazhong University of Science and Technology, Wuhan, China; Jie Li and Ting-Yi Wu, Huawei Technologies Co., Ltd., Hong Kong

Abstract: 

Minimum-storage regenerating (MSR) codes are provably optimal erasure codes that minimize the repair bandwidth (i.e., the amount of traffic being transferred during a repair operation), with the minimum storage redundancy, in distributed storage systems. However, the practical repair performance of MSR codes still has significant room to improve, as the mathematical structure of MSR codes makes their repair operations difficult to parallelize. We present ParaRC, a parallel repair framework for MSR codes. ParaRC exploits the sub-packetization nature of MSR codes to parallelize the repair of sub-blocks and balance the repair load (i.e., the amount of traffic sent or received by a node) across the available nodes. We show that there exists a trade-off between the repair bandwidth and the maximum repair load, and further propose a fast heuristic that approximately minimizes the maximum repair load with limited search time for large coding parameters. We prototype our heuristic in ParaRC and show that ParaRC reduces the degraded read and full-node recovery times over the conventional centralized repair approach in MSR codes by up to 59.3% and 39.2%, respectively.

FAST '23 Open Access Sponsored by
NetApp

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

This content is available to:

BibTeX
@inproceedings {285776,
author = {Xiaolu Li and Keyun Cheng and Kaicheng Tang and Patrick P. C. Lee and Yuchong Hu and Dan Feng and Jie Li and Ting-Yi Wu},
title = {{ParaRC}: Embracing {Sub-Packetization} for Repair Parallelization in {MSR-Coded} Storage},
booktitle = {21st USENIX Conference on File and Storage Technologies (FAST 23)},
year = {2023},
isbn = {978-1-939133-32-8},
address = {Santa Clara, CA},
pages = {17--32},
url = {https://www.usenix.org/conference/fast23/presentation/li-xiaolu},
publisher = {USENIX Association},
month = feb
}

Presentation Video