Learning in multimodal training: Visual guidance can be both appealing and disadvantageous in spatial tasks

Nirit Yuviler-Gavish, Eldad Yechiam, Arava Kallai

Research output: Contribution to journalArticlepeer-review

26 Scopus citations

Abstract

Multimodal training involving both visual and auditory information was shown to improve text comprehension and reduce cognitive load. However, it is argued that in spatial tasks visual guidance can impair training effectiveness because it encourages shallow performance strategies and little exploration. Moreover, visual aids are attractive to both trainers as well as trainees, who tend to use them despite their potential disadvantages. To examine this potential training trap, two experimental studies were conducted. In Study 1, each trainer instructed trainees on how to perform a 3-D puzzle in two conditions: vocal guidance (17 trainees), where only vocal instructions were possible, and vocal guidance with mouse pointing (17 trainees), where the trainer could also use a mouse to point out positions on the trainees screen. The results showed that while the use of the mouse pointer reduced trainees mental load during training, it also drastically lowered performance level on a non-supervised test. In Study 2, a real-world version of puzzle was trained. A comparison of a vocal guidance group (16 trainees) to a group trained with an additional mouse pointing and drawing option (16 trainees) showed, as well, reduced performance levels with the additional visual aids. The results suggest that the abundant use of multimodal training in Augmented Reality (AR) applications should be re-evaluated.

Original languageEnglish
Pages (from-to)113-122
Number of pages10
JournalInternational Journal of Human Computer Studies
Volume69
Issue number3
DOIs
StatePublished - 1 Mar 2011
Externally publishedYes

Keywords

  • Cognitive load
  • Skill acquisition
  • Training
  • Vision

ASJC Scopus subject areas

  • Software
  • Human Factors and Ergonomics
  • Education
  • General Engineering
  • Human-Computer Interaction
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Learning in multimodal training: Visual guidance can be both appealing and disadvantageous in spatial tasks'. Together they form a unique fingerprint.

Cite this