TY - GEN
T1 - Robust Hand Gesture Recognition Using Multimodal Deep Learning for Touchless Visualization of 3D Medical Images
AU - Furusawa, Kotaro
AU - Liu, Jiaqing
AU - Tsujinaga, Seiju
AU - Tateyama, Tomoko
AU - Iwamoto, Yutaro
AU - Chen, Yen Wei
N1 - Publisher Copyright:
© Springer Nature Switzerland AG, 2020.
PY - 2020
Y1 - 2020
N2 - Three-dimensional (3D) visualization of medical images is an important technology for efficiently conducting a surgery. However, efficient review of 3D anatomical models is required to maintain sterile field conditions. An operation using touchless interface for gesture recognition is one of the review methods. Real-time hand gesture application for supporting a surgery requires a robust recognition of various gestures. This study proposes a robust hand gesture recognition using multimodal deep learning to perform recognition using color and depth images. We evaluated the recognition accuracy of 25 different gestures and compared its recognition accuracy with conventional recognition methods. Resultantly, it was found that the proposed system achieves better real-time robust recognition than conventional methods.
AB - Three-dimensional (3D) visualization of medical images is an important technology for efficiently conducting a surgery. However, efficient review of 3D anatomical models is required to maintain sterile field conditions. An operation using touchless interface for gesture recognition is one of the review methods. Real-time hand gesture application for supporting a surgery requires a robust recognition of various gestures. This study proposes a robust hand gesture recognition using multimodal deep learning to perform recognition using color and depth images. We evaluated the recognition accuracy of 25 different gestures and compared its recognition accuracy with conventional recognition methods. Resultantly, it was found that the proposed system achieves better real-time robust recognition than conventional methods.
UR - http://www.scopus.com/inward/record.url?scp=85076963422&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076963422&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-32456-8_65
DO - 10.1007/978-3-030-32456-8_65
M3 - Conference contribution
AN - SCOPUS:85076963422
SN - 9783030324551
T3 - Advances in Intelligent Systems and Computing
SP - 593
EP - 600
BT - Advances in Natural Computation, Fuzzy Systems and Knowledge Discovery - Volume 1
A2 - Liu, Yong
A2 - Wang, Lipo
A2 - Zhao, Liang
A2 - Yu, Zhengtao
PB - Springer
T2 - 15th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2019, co-located with the 5th International Conference on Harmony Search, Soft Computing and Applications, ICHSA 2019
Y2 - 20 July 2019 through 22 July 2019
ER -