Gestonurse: A multimodal robotic scrub nurse

Mithun George Jacob, Yu Ting Li, Juan P. Wachs

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

29 Scopus citations

Abstract

A novel multimodal robotic scrub nurse (RSN) system for the operating room (OR) is presented. The RSN assists the main surgeon by passing surgical instruments. Experiments were conducted to test the system with speech and gesture modalities and average instrument acquisition times were compared. Experimental results showed that 97% of the gestures were recognized correctly under changes in scale and rotation and that the multimodal system responded faster than the unimodal systems. A relationship similar in form to Fitts's law for instrument picking accuracy is also presented.

Original languageEnglish
Title of host publicationHRI'12 - Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction
Pages153-154
Number of pages2
DOIs
StatePublished - 26 Apr 2012
Externally publishedYes
Event7th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI'12 - Boston, MA, United States
Duration: 5 Mar 20128 Mar 2012

Publication series

NameHRI'12 - Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction

Conference

Conference7th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI'12
Country/TerritoryUnited States
CityBoston, MA
Period5/03/128/03/12

Keywords

  • gesture recognition
  • human-robot interaction
  • multimodal interfaces
  • robotic scrub nurse

ASJC Scopus subject areas

  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Gestonurse: A multimodal robotic scrub nurse'. Together they form a unique fingerprint.

Cite this