BROWSE
Detail
Conference Paper
Simple Yet Effective Approach to Repetitive Behavior Classification based on Siamese Network
Cited 0 time in 
Share 
Share
- Authors
- Cheol-Hwan Yoo, Jang-Hee Yoo, Ho-Won Kim, ByungOk Han
- Issue Date
- 2022-08
- Citation
- International Conference on Pattern Recognition (ICPR) 2022, pp.2993-2999
- Language
- English
- Type
- Conference Paper
- Abstract
- Conventional studies dealing with repetition detection have mainly focused on tasks of temporal localization or counting the number of repetitions in videos. However, direct discrimination between repetitive and non-repetitive behaviors in videos, called repetitive behavior classification (RBC), has attracted less attention despite its great potential and advantages of: 1) filling the demands in the fields such as classification of repetitive behaviors in children with autism spectrum disorder (ASD) and helping to alleviate manual and time-consuming diagnostic procedures, 2) directly learning representation of differences between repetition and non-repetition patterns along the temporal dimension, and 3) being an effective alternative to the existing repetition counting and temporal segmentation tasks that are struggling with insufficient data and laborious manual annotation effort. In this paper, to the best of our knowledge, we firstly cast the problem of the RBC using deep learning frameworks. For this, we propose a simple yet effective add-on network, SiRepNet, that exploits the Siamese network structure to learn the inherent properties of repetitive behaviors. We also composed the RBC dataset by re-purposing and re-organizing Kinetics and Countix datasets for training our method. To validate our ideas, we carried out extensive experiments on RBC datasets, which showed performance improvement over state-of-the-art video classification algorithms by simply attaching our scheme to them for the RBC task.
- KSP Keywords
- Behavior classification, Children with autism spectrum disorder(ASD), Classification algorithm, Deep learning framework, Direct discrimination, Insufficient data, Learning representation, Manual annotation, Network structure, Siamese network, Temporal dimension