Markerless 3D gesture-based interaction for handheld Augmented Reality interfaces

Huidong Bai, Lei Gao, Jihad El-Sana, Mark Billinghurst

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

20 Scopus citations

Abstract

Conventional 2D touch-based interaction methods for handheld Augmented Reality (AR) cannot provide intuitive 3D interaction due to a lack of natural gesture input with real-time depth information. The goal of this research is to develop a natural interaction technique for manipulating virtual objects in 3D space on handheld AR devices. We present a novel method that is based on identifying the positions and movements of the user's fingertips, and mapping these gestures onto corresponding manipulations of the virtual objects in the AR scene. We conducted a user study to evaluate this method by comparing it with a common touch-based interface under different AR scenarios. The results indicate that although our method takes longer time, it is more natural and enjoyable to use.

Original languageEnglish
Title of host publication2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013
DOIs
StatePublished - 1 Dec 2013
Event12th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2013 - Adelaide, NSW, Australia
Duration: 1 Oct 20134 Oct 2013

Publication series

Name2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013

Conference

Conference12th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2013
Country/TerritoryAustralia
CityAdelaide, NSW
Period1/10/134/10/13

Keywords

  • 3D interaction technique
  • fingertip detection
  • handheld augmented reality
  • natural gesture interaction

Fingerprint

Dive into the research topics of 'Markerless 3D gesture-based interaction for handheld Augmented Reality interfaces'. Together they form a unique fingerprint.

Cite this