BROWSE
Detail
Conference Paper
GPU Usage Estimation of Deep Learning Training Function for Serverless Computing
Cited 0 time in 
Share 
Share
- Authors
- Chei-Yol Kim, Gyu-Il Cha
- Issue Date
- 2018-10
- Citation
- International Conference on WWW/Internet (ICWI) 2018, pp.101-108
- Language
- English
- Type
- Conference Paper
- Abstract
- Serverless computing is in the spotlight recently as a new form of cloud computing. And one of the most interested software domain in recent years is deep learning applications. Now serverless computing environment is still just CPU-based. This is because GPU devices are not shared by different processes at the same time unlike CPU. To support deep learning applications in serverless computing with low cost, it is essential to support GPU resource sharing. Nvidia supports MPS with execution resource provisioning on the latest Volta architecture GPU. In order to apply MPS and resource provisioning to GPU-based servlerless computing, it is necessary to know the accurate GPU usage of long-term deep learning functions. In this paper, we propose a technique to predict GPU usage of long-term deep learning training function without watching complete execution of it. The proposed technique is composed of sliding window method and coverage based usage estimation. Through the proposed technique, deep learning training functions can be effectively applied to serverless computing with GPU sharing.
- KSP Keywords
- Cloud Computing, Computing Environment, GPU-based, Learning training, Low-cost, Resource provisioning, Resource sharing, Serverless computing, Sliding window method, Software domain, deep learning(DL)