상세정보
학술지
Effective Metadata Management in Exascale File System
- 발행일
- 201911
- 출처
- Journal of Supercomputing, v.75 no.11, pp.7665-7689
- ISSN
- 0920-8542
- 출판사
- Springer
- 협약과제
- 18HS3900, (ICBMS-총괄) ICBMS(IoT, 클라우드, 빅데이터, 모바일, 정보보호) 핵심 기술 개발 사업 총괄 및 엑사스케일급 클라우드 스토리지 기술 개발, 김영균
- 초록
- This paper presents an effective method of managing metadata in exascale file systems. In order to store exponentially growing numbers of files, numerous methods for distributing and managing metadata have been suggested and developed. However, these methods have not provided an appropriate solution for managing a very large amount of metadata because they do not overcome two significant challenges in exascale file systems: (1) nonlinear performance scalability and (2) performance degradation over time. We propose an effective metadata management model and high-performance metadata management system that not only overcome these limitations but also provide a foundation for managing exascale metadata in a distributed file system. The resulting implementation of our metadata management system is the core of EEFS, an exascale distributed file system by the Electronics and Telecommunications Research Institute. The evaluation results show that the critical challenges of existing metadata management technologies are overcome and particularly that the performance is not degraded even when the amount of accumulated metadata increases with time.
- KSP 제안 키워드
- Distributed File system, High performance, Management model, Management system, Over time, Performance and scalability, Performance metadata, Research institute, metadata management, performance degradation