BROWSE
Detail
Conference Paper
A Remote Memory System for High Performance Data Processing
Cited - time in 
Share 
Share
- Authors
- Hyun-Hwa Choi, Kangho Kim, Seung-Jo Bae
- Issue Date
- 2014-12
- Citation
- International Conference on Computer Science and Information Technology (ICCSIT) 2014, pp.50-54
- Language
- English
- Type
- Conference Paper
- Abstract
- Application’s memory footprints are growing exponentially due to an increase in their data set and additional software layer. Modern RDMA capable networks such as InfiniBand and Myrinet with low latency and high bandwidth provide us a new vision to utilize remote memory. Remote idle memory can be exploited to improvement performance of memory intensive applications on individual nodes. Network swapping will be faster than traditional swapping to local disk. In this paper, we design a remote memory system for remote memory utilization in InfiniBand clusters. We present the architecture, communication method and algorithm of InfiniBand Block Device (IBD), which is implemented as loadable kernel module for version 3.5.0-45 of the Linux kernel. Especially, we discuss design issues transfer pages to remote memory. Our experiments show that IBD can bring more performance gain for applications whose working sets are larger than the local memory on a node but smaller than idle memory available on the cluster.
- KSP Keywords
- Block device, Data processing, Data sets, Design issues, High Performance Data, Improvement performance, Linux kernel, Loadable Kernel Module, Local Memory, Low latency, Memory System