An analytic approach to decipher usable gestures for quadriplegic users

Hairong Jiang, Bradley S. Duerstock, Juan P. Wachs

Research output: Contribution to journalConference articlepeer-review

6 Scopus citations

Abstract

With the advent of new gaming technologies, hand gestures are gaining popularity as an effective communication channel for human computer interaction (HCI). This is particularly relevant for patients recovering from mobilityrelated injuries or debilitating conditions who use gesture-based gaming for rehabilitation therapy. Unfortunately, most gesturebased gaming systems are designed for able-bodied users and are difficult and costly to adapt to people with upper extremity mobility impairments. While interface customization is an active area of work in assistive technologies (AT), there is no existing formal and analytical grounded methodology to adapt gesturebased control systems for quadriplegics. The goal of this work is to solve this hurdle by developing a mathematical framework to project the patterns of gestural behavior designed for existing gesture systems to those exhibited by quadriplegic subjects due to spinal cord injury (SCI). A key component of our framework relied on Laban movement analysis (LMA) theory, and consisted of four steps: Acquiring and preprocessing gesture trajectories, extracting feature vectors, training transform functions, and generating constrained gestures. The feasibility of this framework was validated through user-based experimental paradigms and subject validation. It was found that 100% of gestures selected by subjects with high-level SCIs came from the constrained gesture set. Even for the low-level quadriplegic subject, the alternative gestures were preferred.

Original languageEnglish
Article number6974542
Pages (from-to)3912-3917
Number of pages6
JournalConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
Volume2014-January
Issue numberJanuary
DOIs
StatePublished - 1 Jan 2014
Externally publishedYes
Event2014 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2014 - San Diego, United States
Duration: 5 Oct 20148 Oct 2014

Keywords

  • Assistive technology
  • Hand gesture-based interfaces
  • Laban space
  • Mobility impairments

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'An analytic approach to decipher usable gestures for quadriplegic users'. Together they form a unique fingerprint.

Cite this