TY - GEN
T1 - Markerless 3D gesture-based interaction for handheld augmented reality interfaces
AU - Bai, Huidong
AU - Gao, Lei
AU - El-Sana, Jihad
AU - Billinghurst, Mark
PY - 2013/1/1
Y1 - 2013/1/1
N2 - Conventional 2D touch-based interaction methods for handheld Augmented Reality (AR) cannot provide intuitive 3D interaction due to a lack of natural gesture input with real-time depth information. The goal of this research is to develop a natural interaction technique for manipulating virtual objects in 3D space on handheld AR devices. We present a novel method that is based on identifying the positions and movements of the user's fingertips, and mapping these gestures onto corresponding manipulations of the virtual objects in the AR scene. We conducted a user study to evaluate this method by comparing it with a common touch-based interface under different AR scenarios. The results indicate that although our method takes longer time, it is more natural and enjoyable to use.
AB - Conventional 2D touch-based interaction methods for handheld Augmented Reality (AR) cannot provide intuitive 3D interaction due to a lack of natural gesture input with real-time depth information. The goal of this research is to develop a natural interaction technique for manipulating virtual objects in 3D space on handheld AR devices. We present a novel method that is based on identifying the positions and movements of the user's fingertips, and mapping these gestures onto corresponding manipulations of the virtual objects in the AR scene. We conducted a user study to evaluate this method by comparing it with a common touch-based interface under different AR scenarios. The results indicate that although our method takes longer time, it is more natural and enjoyable to use.
KW - 3D interaction technique
KW - fingertip detection
KW - handheld augmented reality
KW - natural gesture interaction
UR - https://www.scopus.com/pages/publications/84897369673
U2 - 10.1145/2543651.2543678
DO - 10.1145/2543651.2543678
M3 - Conference contribution
AN - SCOPUS:84897369673
SN - 9781450326339
T3 - SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications, SA 2013
BT - SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications, SA 2013
PB - Association for Computing Machinery
T2 - SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications, SA 2013
Y2 - 19 November 2013 through 22 November 2013
ER -