상세정보
학술지
Dependency Structure Applied to Language Modeling for Information Retrieval
- 발행일
- 200606
- 출처
- ETRI Journal, v.28 no.3, pp.337-346
- ISSN
- 1225-6463
- 출판사
- 한국전자통신연구원 (ETRI)
- 협약과제
- 05MF1100, 언어정보처리 기술개발, 이영직
- 초록
- In this paper, we propose a new language model, namely, a dependency structure language model, for information retrieval to compensate for the weaknesses of unigram and bigram language models. The dependency structure language model is based on the first-order dependency model and the dependency parse tree generated by a linguistic parser. So, long-distance dependencies can be naturally captured by the dependency structure language model. We carried out extensive experiments to verify the proposed model, where the dependency structure model gives a better performance than recently proposed language models and the Okapi BM25 method, and the dependency structure is more effective than unigram and bigram in language modeling for information retrieval.
- KSP 제안 키워드
- Dependency Parse, Dependency Structure, Information retrieval(IR), Long-distance, Okapi BM25, Parse tree, Proposed model, Structure Model, dependency model, first-order, language modeling