TY - GEN
T1 - Facilitated gesture recognition based interfaces for people with upper extremity physical impairments
AU - Jiang, Hairong
AU - Wachs, Juan P.
AU - Duerstock, Bradley S.
PY - 2012/9/5
Y1 - 2012/9/5
N2 - A gesture recognition based interface was developed to facilitate people with upper extremity physical impairments as an alternative way to perform laboratory experiments that require 'physical' manipulation of components. A color, depth and spatial information based particle filter framework was constructed with unique descriptive features for face and hands representation. The same feature encoding policy was subsequently used to detect, track and recognize users' hands. Motion models were created employing dynamic time warping (DTW) method for better observation encoding. Finally, the hand trajectories were classified into different classes (commands) by applying the CONDENSATION method and, in turn, an interface was designed for robot control, with a recognition accuracy of 97.5%. To assess the gesture recognition and control policies, a validation experiment consisting in controlling a mobile service robot and a robotic arm in a laboratory environment was conducted.
AB - A gesture recognition based interface was developed to facilitate people with upper extremity physical impairments as an alternative way to perform laboratory experiments that require 'physical' manipulation of components. A color, depth and spatial information based particle filter framework was constructed with unique descriptive features for face and hands representation. The same feature encoding policy was subsequently used to detect, track and recognize users' hands. Motion models were created employing dynamic time warping (DTW) method for better observation encoding. Finally, the hand trajectories were classified into different classes (commands) by applying the CONDENSATION method and, in turn, an interface was designed for robot control, with a recognition accuracy of 97.5%. To assess the gesture recognition and control policies, a validation experiment consisting in controlling a mobile service robot and a robotic arm in a laboratory environment was conducted.
KW - CONDENSATION
KW - Gesture recognition
KW - dynamic time warping (DTW)
KW - particle filter
UR - http://www.scopus.com/inward/record.url?scp=84865600436&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-33275-3_28
DO - 10.1007/978-3-642-33275-3_28
M3 - Conference contribution
AN - SCOPUS:84865600436
SN - 9783642332746
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 228
EP - 235
BT - Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications - 17th Iberoamerican Congress, CIARP 2012, Proceedings
T2 - 17th Iberoamerican Congress on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, CIARP 2012
Y2 - 3 September 2012 through 6 September 2012
ER -