상세정보
학술대회
GPU Usage Estimation of Deep Learning Training Function for Serverless Computing
Cited 0 time in 
Download 4 time
Share 
Download 4 time
Share
- 발행일
- 201810
- 출처
- International Conference on WWW/Internet (ICWI) 2018, pp.101-108
- 협약과제
- 18HS1500, 심혈관질환을 위한 인공지능 주치의 기술 개발, 김승환
- 초록
- Serverless computing is in the spotlight recently as a new form of cloud computing. And one of the most interested software domain in recent years is deep learning applications. Now serverless computing environment is still just CPU-based. This is because GPU devices are not shared by different processes at the same time unlike CPU. To support deep learning applications in serverless computing with low cost, it is essential to support GPU resource sharing. Nvidia supports MPS with execution resource provisioning on the latest Volta architecture GPU. In order to apply MPS and resource provisioning to GPU-based servlerless computing, it is necessary to know the accurate GPU usage of long-term deep learning functions. In this paper, we propose a technique to predict GPU usage of long-term deep learning training function without watching complete execution of it. The proposed technique is composed of sliding window method and coverage based usage estimation. Through the proposed technique, deep learning training functions can be effectively applied to serverless computing with GPU sharing.
- KSP 제안 키워드
- Cloud Computing, Computing environment, GPU-based, Learning training, Low-cost, Resource provisioning, Serverless computing, Sliding window method, Software domain, deep learning(DL), learning application