ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Journal Article Effective Metadata Management in Exascale File System
Cited 3 time in scopus Share share facebook twitter linkedin kakaostory
Authors
Myung-Hoon Cha, Sang-Min Lee, Hong-Yeon Kim, Young-Kyun Kim
Issue Date
2019-11
Citation
Journal of Supercomputing, v.75, no.11, pp.7665-7689
ISSN
0920-8542
Publisher
Springer
Language
English
Type
Journal Article
DOI
https://dx.doi.org/10.1007/s11227-019-02974-8
Abstract
This paper presents an effective method of managing metadata in exascale file systems. In order to store exponentially growing numbers of files, numerous methods for distributing and managing metadata have been suggested and developed. However, these methods have not provided an appropriate solution for managing a very large amount of metadata because they do not overcome two significant challenges in exascale file systems: (1) nonlinear performance scalability and (2) performance degradation over time. We propose an effective metadata management model and high-performance metadata management system that not only overcome these limitations but also provide a foundation for managing exascale metadata in a distributed file system. The resulting implementation of our metadata management system is the core of EEFS, an exascale distributed file system by the Electronics and Telecommunications Research Institute. The evaluation results show that the critical challenges of existing metadata management technologies are overcome and particularly that the performance is not degraded even when the amount of accumulated metadata increases with time.
KSP Keywords
Distributed File system, High performance, Management model, Management system, Over time, Performance and scalability, Performance metadata, Research institute, metadata management, performance degradation