ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Journal Article Implementation of a Virtual Training Simulator Based on 360° Multi-View Human Action Recognition
Cited 43 time in scopus Download 3 time Share share facebook twitter linkedin kakaostory
Authors
Beom Kwon, JungHwan Kim, Kyungoh Lee, Yang Koo Lee, Sang Joon Park, Sanghoon Lee
Issue Date
2017-07
Citation
IEEE Access, v.5, pp.12496-12511
ISSN
2169-3536
Publisher
IEEE
Language
English
Type
Journal Article
DOI
https://dx.doi.org/10.1109/ACCESS.2017.2723039
Project Code
16MS4700, Development of ODM-interactive Software Technology supporting Live-Virtual Soldier Exercises, Park Sang Joon
Abstract
Virtual training has received a considerable amount of research attention in recent years due to its potential for use in a variety of applications, such as virtual military training, virtual emergency evacuation, and virtual firefighting. To provide a trainee with an interactive training environment, human action recognition methods have been introduced as a major component of virtual training simulators. Wearable motion capture suit-based human action recognition has been widely used for virtual training, although it may distract the trainee. In this paper, we present a virtual training simulator based on 360째 multi-view human action recognition using multiple Kinect sensors that provides an immersive environment for the trainee without the need to wear devices. To this end, the proposed simulator contains coordinate system transformation, front-view Kinect sensor tracking, multi-skeleton fusion, skeleton normalization, orientation compensation, feature extraction, and classifier modules. Virtual military training is presented as a potential application of the proposed simulator. To train and test it, a database consisting of 25 military training actions was constructed. In the test, the proposed simulator provided an excellent, natural training environment in terms of frame-by-frame classification accuracy, action-by-action classification accuracy, and observational latency.
KSP Keywords
Action Classification, Coordinate system transformation, Feature extractioN, Immersive Environment, Kinect Sensor, Military training, Motion capture, Multi-view, Potential applications, Recognition method, Training environment
This work is distributed under the term of Creative Commons License (CCL)
(CC BY NC ND)
CC BY NC ND