ETRI-Knowledge Sharing Plaform

ENGLISH

성과물

논문 검색
구분 SCI
연도 ~ 키워드

상세정보

학술지 Efficient Techniques of Parallel Recovery for Erasure-coding-based Distributed File Systems
Cited 0 time in scopus Download 4 time
저자
김동오, 김홍연, 김영균, 김정준
발행일
201912
출처
Computing, v.101 no.12, pp.1861-1884
ISSN
0010-485X
출판사
Springer
DOI
https://dx.doi.org/10.1007/s00607-019-00714-7
협약과제
18HS3900, (ICBMS-총괄) ICBMS(IoT, 클라우드, 빅데이터, 모바일, 정보보호) 핵심 기술 개발 사업 총괄 및 엑사스케일급 클라우드 스토리지 기술 개발, 김영균
초록
© 2019, Springer-Verlag GmbH Austria, part of Springer Nature. Replication has been widely used to ensure the data availability in a distributed file system. In recent years, erasure coding (EC) has been adopted to overcome the problem of space efficiency in Replication. However, EC has various performance degrading factors such as parity calculation and degraded input/output. In particular, the recovery performance of EC is degraded because of various factors when the distributed file systems become large. Nonetheless, few studies have been conducted to improve the recovery performance. Thus, this paper proposes an efficient parallel recovery technique in an EC-based distributed file system. We describe the contention avoidance method, chunk allocation method, and asynchronous recovery method, to improve the parallel recovery performance. The contention avoidance method can minimize the contention for resources. The chunk allocation method and asynchronous recovery method can increase the efficiency of the parallel recovery. Finally, we verify that when the proposed parallel recovery technique in this paper is applied to actual distributed file systems, its recovery performance is improved by 263% compared to that of existing methods in the performance evaluation.
키워드
Distributed file system, Erasure coding, ExSTorus-FS, Parallel recovery
KSP 제안 키워드
Allocation method, Chunk allocation, Contention avoidance, Data availability, Degrading factors, Distributed File system, Erasure coding, Performance evaluation, Recovery method, Recovery performance, Space efficiency