Stories of Herbs A multimodal Virtual Reality experience using olfaction

Eshbal Hezroni, Shachar Geiger, Michal Rinott

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Stories of Herbs is a visual, auditory, tactile and olfactory VR experience around the theme of herbs. Our goal is to advance the understanding of how smell can be used actively in our interactions within VR. Specifically, we use physical objects - a mortar and pestle - with which participants actively create smell as part of their action in a corresponding world within VR. In the current experiment participants crush mint leaves, and corresponding virtual leaves guide their attention to an animated story about mint. We examined how enjoyment, recollection of the story, the experienced connection between physical and virtual, and the perceived role of smell were influenced by crushing real mint leaves or odorless paper leaves'. Initial findings from an exploratory study with 15 participants show that the smell was a positive element in the experience, that participants in both the odor and odorless groups experienced a strong connection between the physical and digital elements, and that while some participants felt that smell helped them remember the story, the smell may have contributed to a sensory load that took attention away from the story.

Original languageEnglish
Title of host publicationC and C 2022 - Proceedings of the 14th Creativity and Cognition 2022
PublisherAssociation for Computing Machinery
Number of pages4
ISBN (Electronic)9781450393270
StatePublished - 20 Jun 2022
Externally publishedYes
Event14th ACM Creativity and Cognition Conference, C and C 2022 - Venice, Italy
Duration: 20 Jun 202223 Jun 2022

Publication series

NameACM International Conference Proceeding Series


Conference14th ACM Creativity and Cognition Conference, C and C 2022


  • Interaction design
  • Olfaction
  • Physical-virtual interaction
  • Smell
  • Storytelling
  • Virtual reality

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software


Dive into the research topics of 'Stories of Herbs A multimodal Virtual Reality experience using olfaction'. Together they form a unique fingerprint.

Cite this