상세정보
학술지
Efficient Techniques of Parallel Recovery for Erasure-coding-based Distributed File Systems
- 발행일
- 201912
- 출처
- Computing, v.101 no.12, pp.1861-1884
- ISSN
- 0010-485X
- 출판사
- Springer
- 협약과제
- 18HS3900, (ICBMS-총괄) ICBMS(IoT, 클라우드, 빅데이터, 모바일, 정보보호) 핵심 기술 개발 사업 총괄 및 엑사스케일급 클라우드 스토리지 기술 개발, 김영균
- 초록
- Replication has been widely used to ensure the data availability in a distributed file system. In recent years, erasure coding (EC) has been adopted to overcome the problem of space efficiency in Replication. However, EC has various performance degrading factors such as parity calculation and degraded input/output. In particular, the recovery performance of EC is degraded because of various factors when the distributed file systems become large. Nonetheless, few studies have been conducted to improve the recovery performance. Thus, this paper proposes an efficient parallel recovery technique in an EC-based distributed file system. We describe the contention avoidance method, chunk allocation method, and asynchronous recovery method, to improve the parallel recovery performance. The contention avoidance method can minimize the contention for resources. The chunk allocation method and asynchronous recovery method can increase the efficiency of the parallel recovery. Finally, we verify that when the proposed parallel recovery technique in this paper is applied to actual distributed file systems, its recovery performance is improved by 263% compared to that of existing methods in the performance evaluation.
- KSP 제안 키워드
- Allocation method, Chunk allocation, Contention avoidance, Data availability, Degrading factors, Distributed File system, Erasure coding, Performance evaluation, Recovery method, Recovery performance, Space efficiency