TY - GEN
T1 - Markerless 3D gesture-based interaction for handheld Augmented Reality interfaces
AU - Bai, Huidong
AU - Gao, Lei
AU - El-Sana, Jihad
AU - Billinghurst, Mark
PY - 2013/12/1
Y1 - 2013/12/1
N2 - Conventional 2D touch-based interaction methods for handheld Augmented Reality (AR) cannot provide intuitive 3D interaction due to a lack of natural gesture input with real-time depth information. The goal of this research is to develop a natural interaction technique for manipulating virtual objects in 3D space on handheld AR devices. We present a novel method that is based on identifying the positions and movements of the user's fingertips, and mapping these gestures onto corresponding manipulations of the virtual objects in the AR scene. We conducted a user study to evaluate this method by comparing it with a common touch-based interface under different AR scenarios. The results indicate that although our method takes longer time, it is more natural and enjoyable to use.
AB - Conventional 2D touch-based interaction methods for handheld Augmented Reality (AR) cannot provide intuitive 3D interaction due to a lack of natural gesture input with real-time depth information. The goal of this research is to develop a natural interaction technique for manipulating virtual objects in 3D space on handheld AR devices. We present a novel method that is based on identifying the positions and movements of the user's fingertips, and mapping these gestures onto corresponding manipulations of the virtual objects in the AR scene. We conducted a user study to evaluate this method by comparing it with a common touch-based interface under different AR scenarios. The results indicate that although our method takes longer time, it is more natural and enjoyable to use.
KW - 3D interaction technique
KW - fingertip detection
KW - handheld augmented reality
KW - natural gesture interaction
UR - http://www.scopus.com/inward/record.url?scp=84893265079&partnerID=8YFLogxK
U2 - 10.1109/ISMAR.2013.6671841
DO - 10.1109/ISMAR.2013.6671841
M3 - Conference contribution
AN - SCOPUS:84893265079
SN - 9781479928699
T3 - 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013
BT - 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013
T2 - 12th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2013
Y2 - 1 October 2013 through 4 October 2013
ER -