ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Conference Paper GPU Usage Estimation of Deep Learning Training Function for Serverless Computing
Cited 0 time in scopus Share share facebook twitter linkedin kakaostory
Authors
Chei-Yol Kim, Gyu-Il Cha
Issue Date
2018-10
Citation
International Conference on WWW/Internet (ICWI) 2018, pp.101-108
Language
English
Type
Conference Paper
Abstract
Serverless computing is in the spotlight recently as a new form of cloud computing. And one of the most interested software domain in recent years is deep learning applications. Now serverless computing environment is still just CPU-based. This is because GPU devices are not shared by different processes at the same time unlike CPU. To support deep learning applications in serverless computing with low cost, it is essential to support GPU resource sharing. Nvidia supports MPS with execution resource provisioning on the latest Volta architecture GPU. In order to apply MPS and resource provisioning to GPU-based servlerless computing, it is necessary to know the accurate GPU usage of long-term deep learning functions. In this paper, we propose a technique to predict GPU usage of long-term deep learning training function without watching complete execution of it. The proposed technique is composed of sliding window method and coverage based usage estimation. Through the proposed technique, deep learning training functions can be effectively applied to serverless computing with GPU sharing.
KSP Keywords
Cloud Computing, Computing Environment, GPU-based, Learning training, Low-cost, Resource provisioning, Resource sharing, Serverless computing, Sliding window method, Software domain, deep learning(DL)