Registered
QUANTIZATION METHOD AND DEVICE FOR WEIGHTS OF BATCH NORMALIZATION LAYER
- Inventors
-
Lee Mi Young, Lee Joo Hyun, Kim Jin Kyu, Kim Ju-Yeob, Kim Seong Min, Kim Byung Jo
- Application No.
-
16541275 (2019.08.15)
- Publication No.
-
20200151568 (2020.05.14)
- Registration No.
- 11455539 (2022.09.27)
- Country
- UNITED STATES
- Project Code
-
17HS1600, Feasibility Study of Blue IT based on Human Body Research,
Cho Il Yeon
- Abstract
- An embodiment of the present invention provides a quantization method for weights of a plurality of batch normalization layers, including: receiving a plurality of previously learned first weights of the plurality of batch normalization layers; obtaining first distribution information of the plurality of first weights; performing a first quantization on the plurality of first weights using the first distribution information to obtain a plurality of second weights; obtaining second distribution information of the plurality of second weights; and performing a second quantization on the plurality of second weights using the second distribution information to obtain a plurality of final weights, and thereby reducing an error that may occur when quantizing the weight of the batch normalization layer.
- KSP Keywords
- Batch normalization, Second distribution, distribution information, quantization method, second quantization
- Family
-