상세정보
학술대회
Deep Neural Network based Acoustic Model Parameter Reduction Using Manifold Regularized Low Rank Matrix Factorization
- 발행일
- 201612
- 출처
- Workshop on Spoken Language Technology (SLT) 2016, pp.1-6
- 협약과제
- 16MS1700, 언어학습을 위한 자유발화형 음성대화처리 원천기술 개발, 이윤근
- 초록
- In this paper, we propose a deep neural network (DNN) model parameter reduction based on manifold regularized low rank matrix factorization to reduce the computational complexity of acoustic model for low resource embedded devices. One of the most common DNN model parameter reduction techniques is truncated singular value decomposition (TSVD). TSVD reduces the number of parameters by approximating a target matrix with a low rank one in terms of minimizing the Euclidean norm. In this work, we questioned whether the Euclidean norm is appropriate as objective function to factorize DNN matrices because DNN is known to learn nonlinear manifold of acoustic features. Therefore, in order to exploit the manifold structure for robust parameter reduction, we propose manifold regularized matrix factorization approach. The proposed method was evaluated on TIMIT phone recognition domain.
- KSP 제안 키워드
- Computational complexity, Deep neural network(DNN), Embedded Devices, Euclidean norm, Low-rank matrix, Manifold regularized, Manifold structure, Matrix Factorization, Model parameter, Nonlinear manifold, Reduction technique