BROWSE
Detail
Conference Paper
A Method for Optimizing Deep Learning Object Detection in Edge Computing
Cited 14 time in 
Share 
Share
- Authors
- Ryangsoo Kim, Geonyong Kim, Heedo Kim, Giha Yoon, Hark Yoo
- Issue Date
- 2020-10
- Citation
- International Conference on Information and Communication Technology Convergence (ICTC) 2020, pp.1164-1167
- Publisher
- IEEE
- Language
- English
- Type
- Conference Paper
- Abstract
- Recently, edge computing has received considerable attention as a promising solution to provide deep learning-based video analysis services in real-time. However, due to the limited computation capability of the data processing units (such as CPUs, GPUs, and specialized accelerators) embedded in the edge devices, the question of how to use the limited resources of the edge devices is one of the most pressing issues affecting deep learning-based video analysis service efficiency. In this paper, we introduce a practical approach to optimize deep learning object detection at the edge devices embedding CPUs and GPUs. The proposed approach adopts TVM, an automated end-to-end deep learning compiler that automatically optimizes deep learning workloads with respect to hardware-specific characteristics. In addition, task-level pipeline parallelism is applied to maximize resource utilization of the CPUs and GPUs so as to improve overall object detection performance. Through experiment results, we show that the proposed approach achieves performance improvement for detecting objects on multiple video streams in terms of frame per second.
- KSP Keywords
- Analysis services, Data processing, Edge Computing, Edge devices, End to End(E2E), Experiment results, Learning-based, Limited resources, Practical approach, Real-time, Resource utilization