상세정보
학술지
Development of Real-Time Hand Gesture Recognition for Tabletop Holographic Display Interaction Using Azure Kinect
- 발행일
- 202008
- 출처
- Sensors, v.20 no.16, pp.1-13
- ISSN
- 1424-8220
- 출판사
- MDPI
- 협약과제
- 20JH1200, 디지털 홀로그래픽 테이블탑형 단말 기술 개발, 김진웅
- 초록
- The use of human gesturing to interact with devices such as computers or smartphones has presented several problems. This form of interaction relies on gesture interaction technology such as Leap Motion from Leap Motion, Inc, which enables humans to use hand gestures to interact with a computer. The technology has excellent hand detection performance, and even allows simple games to be played using gestures. Another example is the contactless use of a smartphone to take a photograph by simply folding and opening the palm. Research on interaction with other devices via hand gestures is in progress. Similarly, studies on the creation of a hologram display from objects that actually exist are also underway. We propose a hand gesture recognition system that can control the Tabletop holographic display based on an actual object. The depth image obtained using the latest Time-of-Flight based depth camera Azure Kinect is used to obtain information about the hand and hand joints by using the deep-learning model CrossInfoNet. Using this information, we developed a real time system that defines and recognizes gestures indicating left, right, up, and down basic rotation, and zoom in, zoom out, and continuous rotation to the left and right.
- KSP 제안 키워드
- Depth camera, Depth image, Hand detection, Hand gesture recognition system, Leap Motion, Learning model, continuous rotation, deep learning(DL), detection performance, gesture interaction, holographic display
본 저작물은 크리에이티브 커먼즈 저작자 표시 (CC BY) 조건에 따라 이용할 수 있습니다.
