Robust Hand Gesture Recognition Using Multimodal Deep Learning for Touchless Visualization of 3D Medical Images

Kotaro Furusawa, Jiaqing Liu, Seiju Tsujinaga, Tomoko Tateyama, Yutaro Iwamoto, Yen Wei Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Three-dimensional (3D) visualization of medical images is an important technology for efficiently conducting a surgery. However, efficient review of 3D anatomical models is required to maintain sterile field conditions. An operation using touchless interface for gesture recognition is one of the review methods. Real-time hand gesture application for supporting a surgery requires a robust recognition of various gestures. This study proposes a robust hand gesture recognition using multimodal deep learning to perform recognition using color and depth images. We evaluated the recognition accuracy of 25 different gestures and compared its recognition accuracy with conventional recognition methods. Resultantly, it was found that the proposed system achieves better real-time robust recognition than conventional methods.

Original languageEnglish
Title of host publicationAdvances in Natural Computation, Fuzzy Systems and Knowledge Discovery - Volume 1
EditorsYong Liu, Lipo Wang, Liang Zhao, Zhengtao Yu
PublisherSpringer
Pages593-600
Number of pages8
ISBN (Print)9783030324551
DOIs
Publication statusPublished - 2020
Externally publishedYes
Event15th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2019, co-located with the 5th International Conference on Harmony Search, Soft Computing and Applications, ICHSA 2019 - Kunming, China
Duration: 20-07-201922-07-2019

Publication series

NameAdvances in Intelligent Systems and Computing
Volume1074
ISSN (Print)2194-5357
ISSN (Electronic)2194-5365

Conference

Conference15th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2019, co-located with the 5th International Conference on Harmony Search, Soft Computing and Applications, ICHSA 2019
Country/TerritoryChina
CityKunming
Period20-07-1922-07-19

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Robust Hand Gesture Recognition Using Multimodal Deep Learning for Touchless Visualization of 3D Medical Images'. Together they form a unique fingerprint.

Cite this