Active Assembly Guidance with Online Video Parsing

Bin Wang, Guofeng Wang, Andrei Sharf, Yangyan Li, Fan Zhong, Xueying Qin, Daniel Cohenor, Baoquan Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

In this paper, we introduce an online video-based system that actively assists users in assembly tasks. The system guides and monitors the assembly process by providing instructions and feedback on possibly erroneous operations, enabling easy and effective guidance in AR/MR applications. The core of our system is an online video-based assembly parsing method that can understand the assembly process, which is known to be extremely hard previously. Our method exploits the availability of the participating parts to significantly alleviate the problem, reducing the recognition task to an identification problem, within a constrained search space. To further constrain the search space, and understand the observed assembly activity, we introduce a tree-based global-inference technique. Our key idea is to incorporate part-interaction rules as powerful constraints which significantly regularize the search space and correctly parse the assembly video at interactive rates. Complex examples demonstrate the effectiveness of our method.

Original languageEnglish
Title of host publication25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018 - Proceedings
EditorsFrank Steinicke, Bruce Thomas, Kiyoshi Kiyokawa, Greg Welch
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages459-466
Number of pages8
ISBN (Print)9781538633656
DOIs
StatePublished - 2018
Event25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018 - Reutlingen, Germany
Duration: 18 Mar 201822 Mar 2018

Publication series

Name25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018 - Proceedings

Conference

Conference25th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2018
Country/TerritoryGermany
CityReutlingen
Period18/03/1822/03/18

Keywords

  • Computing methodologies
  • Computer graphics
  • Mixed / augmented reality

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Media Technology
  • Modeling and Simulation

Fingerprint

Dive into the research topics of 'Active Assembly Guidance with Online Video Parsing'. Together they form a unique fingerprint.

Cite this