ETRI-Knowledge Sharing Plaform

ENGLISH

성과물

논문 검색
구분 SCI
연도 ~ 키워드

상세정보

학술지 Accelerating On-Device Learning with Layer-Wise Processor Selection Method on Unified Memory
Cited 3 time in scopus Download 143 time Share share facebook twitter linkedin kakaostory
저자
하동휘, 김무섭, 문경덕, 정치윤
발행일
202104
출처
Sensors, v.21 no.7, pp.1-19
ISSN
1424-8220
출판사
MDPI
DOI
https://dx.doi.org/10.3390/s21072364
협약과제
21ZS1200, 인간중심의 자율지능시스템 원천기술연구, 최정단
초록
Recent studies have applied the superior performance of deep learning to mobile devices, and these studies have enabled the running of the deep learning model on a mobile device with limited computing power. However, there is performance degradation of the deep learning model when it is deployed in mobile devices, due to the different sensors of each device. To solve this issue, it is necessary to train a network model specific to each mobile device. Therefore, herein, we propose an acceleration method for on-device learning to mitigate the device heterogeneity. The proposed method efficiently utilizes unified memory for reducing the latency of data transfer during network model training. In addition, we propose the layer-wise processor selection method to consider the latency generated by the difference in the processor performing the forward propagation step and the backpropagation step in the same layer. The experiments were performed on an ODROID-XU4 with the ResNet-18 model, and the experimental results indicate that the proposed method reduces the latency by at most 28.4% compared to the central processing unit (CPU) and at most 21.8% compared to the graphics processing unit (GPU). Through experiments using various batch sizes to measure the average power consumption, we confirmed that device heterogeneity is alleviated by performing on-device learning using the proposed method.
KSP 제안 키워드
Acceleration method, Average power consumption, Computing power, Data transfer, Device heterogeneity, Forward Propagation, Graphic Processing Unit(GPU), Learning model, Mobile devices, Network model, Selection method
본 저작물은 크리에이티브 커먼즈 저작자 표시 (CC BY) 조건에 따라 이용할 수 있습니다.
저작자 표시 (CC BY)