Interactive projection for aerial dance using depth sensing camera

Tammuz Dubnov, Zachary Seldess, Shlomo Dubnov

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


This paper describes an interactive performance system for oor and Aerial Dance that controls visual and sonic aspects of the presentation via a depth sensing camera (MS Kinect). In order to detect, measure and track free movement in space, 3 degree of freedom (3-DOF) tracking in space (on the ground and in the air) is performed using IR markers. Gesture tracking and recognition is performed using a simpli ed HMM model that allows robust mapping of the actor's actions to graphics and sound. Additional visual e ects are achieved by segmentation of the actor body based on depth information, allowing projection of separate imagery on the performer and the backdrop. Artistic use of augmented reality performance relative to more traditional concepts of stage design and dramaturgy are discussed.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - The Engineering Reality of Virtual Reality 2014
ISBN (Print)9780819499295
StatePublished - 1 Jan 2014
Externally publishedYes
EventThe Engineering Reality of Virtual Reality 2014 - San Francisco, CA, United States
Duration: 3 Feb 20144 Feb 2014

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


ConferenceThe Engineering Reality of Virtual Reality 2014
Country/TerritoryUnited States
CitySan Francisco, CA


  • Aerial Dance
  • Augmented Reality
  • Circus Aerials
  • Gesture Tracking
  • Kinect
  • Projection Design
  • RGB-D Camera

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Interactive projection for aerial dance using depth sensing camera'. Together they form a unique fingerprint.

Cite this