BROWSE
Detail
Journal Article
Dependency Structure Applied to Language Modeling for Information Retrieval
- Authors
- Chang Ki Lee, Gary Geunbae Lee, Myung Gil Jang
- Issue Date
- 2006-06
- Citation
- ETRI Journal, v.28, no.3, pp.337-346
- ISSN
- 1225-6463
- Publisher
- 한국전자통신연구원 (ETRI)
- Language
- English
- Type
- Journal Article
- Abstract
- In this paper, we propose a new language model, namely, a dependency structure language model, for information retrieval to compensate for the weaknesses of unigram and bigram language models. The dependency structure language model is based on the first-order dependency model and the dependency parse tree generated by a linguistic parser. So, long-distance dependencies can be naturally captured by the dependency structure language model. We carried out extensive experiments to verify the proposed model, where the dependency structure model gives a better performance than recently proposed language models and the Okapi BM25 method, and the dependency structure is more effective than unigram and bigram in language modeling for information retrieval.
- KSP Keywords
- Dependency Parse, Dependency Structure, First-order, Language modeling, Long distance, Okapi BM25, Parse tree, Proposed model, Structure Model, dependency model, information retrieval