Gestix: A doctor-computer sterile gesture interface for dynamic environments

Juan Wachs, Helman Stern, Yael Edan, Michael Gillam, Craig Feied, Mark Smith, Jon Handler

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

24 Scopus citations


In this paper, we design a sterile gesture interface for users, such as doctors/surgeons, to browse medical images in a dynamic medical environment. A vision-based gesture capture system interprets user's gestures in real-time to navigate through and manipulate an image and data visualization environment. Dynamic navigation gestures are translated to commands based on their relative positions on the screen. The gesture system relies on tracking of the user's hand based on color-motion cues. A state machine switches from navigation gestures to others such as zoom and rotate. A prototype of the gesture interface was tested in an operating room by neurosurgeons conducting a live operation. Surgeon's feedback was very positive.

Original languageEnglish
Title of host publicationSoft Computing in Industrial Applications
Subtitle of host publicationRecent Trends
EditorsAshraf Saad, Erel Avineri, Keshav Dahal, Muhammad Sarfraz, Rajkumar Roy
Number of pages10
StatePublished - 1 Dec 2007

Publication series

NameAdvances in Soft Computing
ISSN (Print)1615-3871
ISSN (Electronic)1860-0794


  • Browsing
  • Hand gesture recognition
  • Image visualization
  • Medical databases
  • Sterile interface


Dive into the research topics of 'Gestix: A doctor-computer sterile gesture interface for dynamic environments'. Together they form a unique fingerprint.

Cite this