TY - GEN
T1 - Shape recognition and pose estimation for mobile augmented reality
AU - Hagbi, Nate
AU - Bergig, Oriel
AU - El-Sana, Jihad
AU - Billinghurst, Mark
PY - 2009/12/1
Y1 - 2009/12/1
N2 - In this paper we present Nestor, a system for real-time recognition and camera pose estimation from planar shapes. The system allows shapes that carry contextual meanings for humans to be used as Augmented Reality (AR) tracking fiducials. The user can teach the system new shapes at runtime by showing them to the camera. The learned shapes are then maintained by the system in a shape library. Nestor performs shape recognition by analyzing contour structures and generating projective invariant signatures from their concavities. The concavities are further used to extract features for pose estimation and tracking. Pose refinement is carried out by minimizing the reprojection error between sample points on each image contour and its library counterpart. Sample points are matched by evolving an active contour in real time. Our experiments show that the system provides stable and accurate registration, and runs at interactive frame rates on a Nokia N95 mobile phone.
AB - In this paper we present Nestor, a system for real-time recognition and camera pose estimation from planar shapes. The system allows shapes that carry contextual meanings for humans to be used as Augmented Reality (AR) tracking fiducials. The user can teach the system new shapes at runtime by showing them to the camera. The learned shapes are then maintained by the system in a shape library. Nestor performs shape recognition by analyzing contour structures and generating projective invariant signatures from their concavities. The concavities are further used to extract features for pose estimation and tracking. Pose refinement is carried out by minimizing the reprojection error between sample points on each image contour and its library counterpart. Sample points are matched by evolving an active contour in real time. Our experiments show that the system provides stable and accurate registration, and runs at interactive frame rates on a Nokia N95 mobile phone.
KW - 3D pose estimation
KW - Free-hand sketching
KW - Geometric projective invariance
KW - Handheld AR
KW - In-place augmented reality
KW - Shape dual perception
KW - Shape recognition
KW - Vision-based tracking
UR - http://www.scopus.com/inward/record.url?scp=74549193462&partnerID=8YFLogxK
U2 - 10.1109/ISMAR.2009.5336498
DO - 10.1109/ISMAR.2009.5336498
M3 - Conference contribution
AN - SCOPUS:74549193462
SN - 9781424453900
T3 - Science and Technology Proceedings - IEEE 2009 International Symposium on Mixed and Augmented Reality, ISMAR 2009
SP - 65
EP - 71
BT - Science and Technology Proceedings - IEEE 2009 International Symposium on Mixed and Augmented Reality, ISMAR 2009
T2 - 8th IEEE 2009 International Symposium on Mixed and Augmented Reality, ISMAR 2009 - Science and Technology
Y2 - 19 October 2009 through 22 October 2009
ER -