| Title | An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm |
| Publication Type | Conference Paper |
| Year of Publication | 2020 |
| Authors | Wang, Zizhong, Wang, Haixia, Shao, Airan, Wang, Dongsheng |
| Conference Name | 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS) |
| Date Published | Dec. 2020 |
| Publisher | IEEE |
| ISBN Number | 978-1-7281-7002-2 |
| Keywords | adaptive scheme, code switch, Computational efficiency, Conferences, degraded read, distributed computing, erasure code, Fault tolerance, Fault tolerant systems, i-o systems security, pubcrawl, Scalability, Switches, telecommunication traffic |
| Abstract | Using erasure codes increases consumption of network traffic and disk I/O tremendously when systems recover data, resulting in high latency of degraded reads. In order to mitigate this problem, we present an adaptive storage scheme based on data access skew, a fact that most data accesses are applied in a small fraction of data. In this scheme, we use both Local Reconstruction Code (LRC), whose recovery cost is low, to store frequently accessed data, and Hitchhiker (HH) code, which guarantees minimum storage cost, to store infrequently accessed data. Besides, an efficient switching algorithm between LRC and HH code with low network and computation costs is provided. The whole system will benefit from low degraded read latency while keeping a low storage overhead, and code-switching will not become a bottleneck. |
| URL | https://ieeexplore.ieee.org/document/9355827/ |
| DOI | 10.1109/ICDCS47774.2020.00129 |
| Citation Key | wang_adaptive_2020 |
An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm