등록
원격 공유 메모리 파라미터 서버 기반 분산 딥러닝 파라미터 공유 방법
- 발명자
-
안신영, 임은지, 최용석, 우영춘, 강동재, 최완
- 출원번호
-
17216322 (2021.03.29)
- 공개번호
-
20210216495 (2021.07.15)
- 등록번호
- 11487698 (2022.11.01)
- 출원국
- 미국
- 협약과제
-
16HS1200, 대규모 딥러닝 고속 처리를 위한 HPC 시스템 개발,
최완
- 초록
- Disclosed herein are a parameter server and a method for sharing distributed deep-learning parameters using the parameter server. The method for sharing distributed deep-learning parameters using the parameter server includes initializing a global weight parameter in response to an initialization request by a master process; performing an update by receiving a learned local gradient parameter from the worker process, which performs deep-learning training after updating a local weight parameter using the global weight parameter; accumulating the gradient parameters in response to a request by the master process; and performing an update by receiving the global weight parameter from the master process that calculates the global weight parameter using the accumulated gradient parameters of the one or more worker processes.
- KSP 제안 키워드
- Learning parameters, Learning training, Local Gradient(LG), Parameter server, deep learning(DL)
- 패밀리
-