Kinect-based real-time gesture recognition using deep convolutional neural networks for touchless visualization of hepatic anatomical models in surgery

Jia Qing Liu, Tomoko Tateyama, Yutaro Iwamoto, Yen Wei Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper, we present a novel touchless interaction system for visualization of hepatic anatomical models in surgery. Real-time visualization is important in surgery, particularly during the operation. However, it often faces the challenge of efficiently reviewing the patient’s 3D anatomy model while maintaining a sterile field. The touchless technology is an attractive and potential solution to address the above problem. We use a Microsoft Kinect sensor as input device to produce depth images for extracting a hand without markers. Based on this representation, a deep convolutional neural network is used to recognize various hand gestures. Experimental results demonstrate that our system can significantly improve the response time while achieve almost same accuracy compared with the previous researches.

Original languageEnglish
Title of host publicationIntelligent Interactive Multimedia Systems and Services - Proceedings of 2018 Conference
EditorsRobert J. Howlett, Lakhmi C. Jain, Lakhmi C. Jain, Giuseppe De Pietro, Luigi Gallo, Lakhmi C. Jain, Ljubo Vlacic, Robert J. Howlett
PublisherSpringer Science and Business Media Deutschland GmbH
Pages223-229
Number of pages7
ISBN (Print)9783319922300
DOIs
Publication statusPublished - 2019
Externally publishedYes
Event11th International KES Conference on Intelligent Interactive Multimedia: Systems and Services, KES-IIMSS 2018 - Gold Coast, Australia
Duration: 20-06-201822-06-2018

Publication series

NameSmart Innovation, Systems and Technologies
Volume98
ISSN (Print)2190-3018
ISSN (Electronic)2190-3026

Conference

Conference11th International KES Conference on Intelligent Interactive Multimedia: Systems and Services, KES-IIMSS 2018
Country/TerritoryAustralia
CityGold Coast
Period20-06-1822-06-18

All Science Journal Classification (ASJC) codes

  • Decision Sciences(all)
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Kinect-based real-time gesture recognition using deep convolutional neural networks for touchless visualization of hepatic anatomical models in surgery'. Together they form a unique fingerprint.

Cite this