상세정보
학술지
Temporal Filtering Networks for Online Action Detection
- 저자
- 은현준, 문진영, 박종열, 정찬호, 김창익
- 발행일
- 202103
- 출처
- Pattern Recognition, v.111, pp.1-12
- ISSN
- 0031-3203
- 출판사
- Elsevier
- 협약과제
- 21HS4800, 장기 시각 메모리 네트워크 기반의 예지형 시각지능 핵심기술 개발, 문진영
- 초록
- Online action detection aims to detect a current action from an untrimmed, streaming video, where only current and past frames are available. Recent methods for online action detection have focused on how to model discriminative representations from temporally partial information. However, they overlook the fact that the input video contains background as well as actions. To overcome this problem, in this paper, we propose a novel approach, named Temporal Filtering Network, to distinguish between relevant and irrelevant information from a partially observed, untrimmed video. Specifically, we present a filtering module to learn relevance scores indicating how relevant the information is to a current action. Our filtering module emphasizes the relevant information to a current action, while it filters out the information of background and unrelated actions. We conduct extensive experiments on THUMOS-14 and TVSeries datasets. On these datasets, the proposed method outperforms state-of-the-art methods by a large margin. We also show the effectiveness of the filtering module through comprehensive ablation studies.
- KSP 제안 키워드
- Irrelevant information, Novel approach, Online Action Detection, Partial information, Streaming video, Temporal filtering, large margin, state-of-The-Art