BROWSE
Detail
Conference Paper
Does Identity Mapping Really Help in ResNet?
Cited 0 time in 
Share 
Share
- Authors
- Yoo-Kyung Lee, Dong-Hwan Lee, Jae-Hun Choi, Jang-Hee Yoo, Seung-Ik Lee
- Issue Date
- 2021-10
- Citation
- International Conference on Information and Communication Technology Convergence (ICTC) 2021, pp.1077-1080
- Publisher
- IEEE
- Language
- English
- Type
- Conference Paper
- Abstract
- ResNet proposed residual learning using skip connections that perform identity mapping. However, as shown in the study [1], identity mappings for skip connections may not be the optimal or at least not the only way to get a good performance in ResNet. In this paper, we explore various types of skip connections, including shortcuts with or without identity mapping, to see their effects on the performance of ResNet and provide a comparison of the various methods. Our extensive experiments suggest that the use of identity shortcuts is the most appropriate than other methods in terms of model simplicity and performance.
- KSP Keywords
- Identity mapping, residual learning, skip connections