Learning in multimodal training: Visual guidance can be both appealing and disadvantageous in spatial tasks

Multimodal training involving both visual and auditory information was shown to improve text comprehension and reduce cognitive load. However, it is argued that in spatial tasks visual guidance can impair training effectiveness because it encourages shallow performance strategies and little exploration. Moreover, visual aids are attractive to both trainers as well as trainees, who tend to use them despite their potential disadvantages. To examine this potential training trap, two experimental studies were conducted. In Study 1, each trainer instructed trainees on how to perform a 3-D puzzle in two conditions: vocal guidance (17 trainees), where only vocal instructions were possible, and vocal guidance with mouse pointing (17 trainees), where the trainer could also use a mouse to point out positions on the trainee's screen. The results showed that while the use of the mouse pointer reduced trainees' mental load during training, it also drastically lowered performance level on a non-supervised test. In Study 2, a real-world version of puzzle was trained. A comparison of a vocal guidance group (16 trainees) to a group trained with an additional mouse pointing and drawing option (16 trainees) showed, as well, reduced performance levels with the additional visual aids. The results suggest that the abundant use of multimodal training in Augmented Reality (AR) applications should be re-evaluated.