BROWSE
Detail
Journal Article
Multimodal Approach for Summarizing and Indexing News Video
- Authors
- Jae-Gon Kim, Hyun Sung Chang, Young-tae Kim, Kyeong Ok Kang, Mun Churl Kim, Jin Woong Kim, Hyung-Myung Kim
- Issue Date
- 2002-02
- Citation
- ETRI Journal, v.24, no.1, pp.1-11
- ISSN
- 1225-6463
- Publisher
- 한국전자통신연구원 (ETRI)
- Language
- English
- Type
- Journal Article
- Abstract
- A video summary abstracts the gist from an entire video and also enables efficient access to the desired content. In this paper, we propose a novel method for summarizing news video based on multimodal analysis of the content. The proposed method exploits the closed caption data to locate semantically meaningful highlights in a news video and speech signals in an audio stream to align the closed caption data with the video in a time-line. Then, the detected highlights are described using MPEG-7 Summarization Description Scheme, which allows efficient browsing of the content through such functionalities as multi-level abstracts and navigation guidance. Multimodal search and retrieval are also within the proposed framework. By indexing synchronized closed caption data, the video clips are searchable by inputting a text query. Intensive experiments with prototypical systems are presented to demonstrate the validity and reliability of the proposed method in real applications.
- KSP Keywords
- Audio stream, Closed caption, MPEG-7, Multi-level, Multimodal analysis, Multimodal approach, Multimodal search, Search and retrieval, Speech Signals, Video clips, Video summary