Does modality play a role? Visual‐verbal cognitive style and multimedia learning

The study presented in this paper aimed to examine the effect of visual and verbal cognitive style on learning from different types of visualization and modalities of explanatory text. Learning materials in the form of either computer‐based animation or a series of static pictures with written or spoken explanations were presented to 197 students. We found that a more developed visual cognitive style was related to a better learning outcome, when learning from a combination of static pictures and written text. Higher developed visualizers achieved poorer learning outcomes when learning with an animation and written text. The results are partially in line with an ability‐as‐compensator effect and the expertise reversal effect. Additionally, we found a modality effect as the versions with spoken text provided better results on learning outcome than the versions with written text regardless of the prominence of visual cognitive style. No significant interaction effects were found regarding verbal cognitive style.     

The role of spatial ability when fostering mental animation in multimedia learning: An ATI-study

The present Aptitude-Treatment-Interaction (ATI) study investigates the learner characteristic spatial ability (aptitude) and the variation of mental-animation prompts (treatment: no vs. mental-animation prompts). A group of high-school students (N = 94) learned about a biology topic through learner-paced multimedia instruction. Some of the learners received mental-animation prompts and others learned without prompts. A fine-grained analysis with spatial ability as continuous aptitude variable and mental animation as treatment showed a positive learning effect of animation prompts in learning outcomes of processes, but not in knowledge about structures. In addition, spatial ability only modified the relationship between animation prompts and learning when analyzing knowledge about processes. Specifically, only learners of low to medium spatial ability profited from the prompts while learners with very low or high spatial ability had comparable results when learning with or without prompts. In addition, only learners with high spatial ability rated their cognitive load to be significantly higher when learning with prompts. Results align with the assumptions of the production deficiency of learners with low to medium spatial ability, mediation deficiency of learners with very low spatial ability and stable learning performance of learners with high spatial ability whatever the learning situation offers.     

Cognitive load and science text comprehension: Effects of drawing and mentally imagining text content

One hundred and eleven 10th graders read an expository science text on the dipole character of water molecules (ca. 1600 words). Reading instruction was varied according to a 2 × 2 experimental design with factors ‘drawing pictures of text content on paper’ (yes, no) and ‘mentally imagining text content while reading’ (yes, no). The results indicate that drawing pictures, mediated through increased cognitive load, decreased text comprehension and, thus, learning (d = −0.37), whereas mental imagery, although decreasing cognitive load, increased comprehension only when students did not have to draw pictures simultaneously (d = 0.72). No evidence was found that the effects were moderated by domain-specific prior knowledge, verbal ability, or spatial ability. The results are in line with cognitive theories of multimedia learning, self-regulated learning, and mental imagery as well as conceptions of science learning that focus on promoting mental model construction by actively visualizing the content to be learned. Constructing mental images seems to reduce cognitive load and to increase comprehension and learning outcome when the mental visualization processes are not disturbed by externally drawing pictures on paper, whereas drawing pictures seems to increase cognitive load resulting in reduced comprehension and learning outcome.     

An empirical evaluation of multi-media based learning of a procedural task

The present study investigated the effects of multi-media modules and their combinations on the learning of procedural tasks. In the experiment, 72 participants were classified as having either low- or high spatial ability based on their spatial ability test. They were randomly assigned to one of the six experimental conditions in a 2 × 3 factorial design with verbal modality (on-screen text procedure vs. auditory procedure) and the format of visual representation (static visual representation vs. static visual representation with motion cues vs. animated visual representation). After they completed their learning session, the ability to perform the procedural task was directly measured in a realistic setting. The results revealed that: (1) in the condition of static visual representation, the high spatial ability group outperformed the low spatial ability group, (2) for the low spatial ability participants, the animated visual representation group outperformed the static visual representation group, however, the static visual representation with motion cues group did not outperform the static visual representation group, (3) the use of animated visual representation helped participants with low spatial ability more than those with high spatial ability, and (4) a modality effect was found for the measure of satisfaction when viewing the animated visual representation. Since the participants with low spatial ability benefited from the use of animation, the results might support an idea that people are better able to retrieve the procedural information by viewing animated representation. The findings also might reflect a preference for the auditory mode of presentation with greater familiarity with the type of visual representation.     

The effects of visualization format and spatial ability on learning star motions

The purpose of this study was to investigate not only the effectiveness of dynamic versus static visualizations on learning star motions but also the influence of students' spatial abilities with these two types of visualizations on their learning. We assigned 155 fifth-grade students to either a dynamic or a static condition. We used a science achievement test to measure student learning outcomes by assessing knowledge acquisition. We classified students as having either a low or high spatial ability based on their test scores for primary mental abilities, specifically spatial relations. The results showed that dynamic visualizations were more effective than static visualizations for learning complex concepts involving star motions. Furthermore, learners' spatial abilities had a positive effect on their learning outcomes but did not moderate the effectiveness of dynamic versus static visualizations for learning in this domain. Our findings suggest that when designing instructional materials, the dynamic properties of visualizations should be aligned with the dynamic nature of the subject matter. We conclude that students' spatial abilities are beneficial to learning, especially when they are studying a complex domain that demands spatial changes and moving processes; therefore, our findings support the importance of assessing spatial ability in learning with visualizations.     

Evaluating animations as student aids in learning computer algorithms

We conducted two experiments designed to examine whether animations of algorithms would help students learn the algorithms more effectively. Across the two studies we used two different algorithms — depth-first search and binomial heaps — and used two different subject populations — students with little or no computer science background and students who were computer science majors — and examined whether animations helped students acquire procedural and conceptual knowledge about the algorithms. The results suggest that one way animations may aid learning of procedural knowledge is by encouraging learners to predict the algorithm's behavior. However, such a learning improvement was also found when learners made predictions of an algorithm's behavior from static diagrams. This suggests that prediction, rather than animation per se, may have been the key factor in aiding learning in the present studies. These initial experiments served to highlight a number of methodological issues that need to be systematically addressed in future experiments in order to fully test the relationship between animation and prediction as well as to examine other possible benefits of animations on learning.     

Using video and static pictures to improve learning of procedural contents

Animations and videos are often designed to present information that involves change over time, in such a way as to aid understanding and facilitate learning. However, in many studies, static displays have been found to be just as beneficial and sometimes better. In this study, we investigated the impact of presenting together both a video recording and a series of static pictures. In experiment 1, we compared 3 conditions (1) video shown alone, (2) static pictures displayed alone, and (3) video plus static pictures. On average the best learning scores were found for the 3rd condition. In experiment 2 we investigated how best to present the static pictures, by examining the number of pictures required (low vs. high frequency) and their appearance type (static vs. dynamic). We found that the dynamic presentation of pictures was superior to the static pictures mode; and showing fewer pictures (low frequency) was more beneficial. Overall the findings support the effectiveness of a combination of instructional animation with static pictures. However, the number of static pictures, which are used, is an important moderating factor.     

A review of learning demands in instructional animations: The educational effectiveness of animations unfolds if the features of change need to be learned

In a systematic review, 194 studies on learning from animation were analysed. The analysis covers the learning domains, the representational characteristics of the animations, the assessed perceptual and cognitive achievements, and the assessment formats. Research on learning from animation focuses on assessing conceptual at the neglect of kinematic mental models. This is in contrast to an important rationale for making use of animations: that it needs to be learned what animations can specifically display, namely, how change in space and time occurs. This might explain why meta-analyses which compared the effectiveness of animations and static pictures found merely small overall effect sizes in favour of animations. To confirm this hypothesis, one meta-analysis was re-analysed with a new moderator. It encodes whether the features of the displayed changes were relevant to learning. Learning from animations was significantly more successful than learning from static pictures, if the features of the displayed changes had to be learned.     

Rethinking the evaluation of algorithm animations as learning aids: an observational study

One important aspect of creating computer programs is having a sound understanding of the underlying algorithms used by programs. Learning about algorithms, just like learning to program, is difficult, however. A number of prior studies have found that using animation to help teach algorithms had less beneficial effects on learning than hoped. Those results surprise many computer science instructors whose intuition leads them to believe that algorithm animations should assist instruction. This article reports on a study in which animation is utilized in more of a “homework” learning scenario rather than a “final exam” scenario. Our focus is on understanding how learners will utilize animation and other instructional materials in trying to understand a new algorithm, and on gaining insight into how animations can fit into successful learning strategies. The study indicates that students use sophisticated combinations of instructional materials in learning scenarios. In particular, the presence of algorithm animations seems to make a complicated algorithm more accessible and less intimidating, thus leading to enhanced student interaction with the materials and facilitating learning.     

Improving learning from animated soccer scenes: Evidence for the expertise reversal effect

In two experiments, we investigated how animation of play (soccer) should be designed in order to avoid the high cognitive load due to the fleeting nature of information. Using static pictures and altering the animation’s presentation speed have been proposed as instructional strategies to reduce learners’ cognitive load. In the first experiment, we tested the effect of static vs. animated presentations on learning. The results indicated that novices benefited more from the static presentation whereas experts benefited more from the animated presentation. The second experiment investigated the effect of low vs. normal vs. high levels of presentation speed on learning. The results showed that novices profited more from the low presentation speed while experts profited more from the normal and high presentation speeds. Thus both experiments demonstrated the occurrences of the expertise reversal effect. Findings suggest that the effectiveness of instructional strategies depends on levels of soccer players’ expertise.     

Effects of spatial ability and richness of motion cue on learning in mechanically complex domain

This study seeks to examine the impact of individual differences in the spatial ability of learners to integrate verbal information and three modes of visual representations. Several hypotheses were tested, including that (1) individual difference in spatial ability should influence the learning of theoretical knowledge when the instructional materials present a static visual representation at the lowest motion cue richness, and (2) both animations and the static visual representation containing motion cues should be more effective than static visual representation, especially for learners with low spatial ability. In the experiment, 60 learners were classified as having either low or high spatial ability on the basis of their performance on the Kit of Factor Referenced Cognitive Tests. The learners got knowledge from written explanations describing a four-stroke engine mechanism in a computer-based format. Also, written explanations were reinforced by corresponding visual representations with three levels of motion cue richness (static images, static images with motion cues or animations). Understanding was measured by a problem-solving transfer test. The results indicate that (1) presenting written explanations with corresponding animations did not improve performance of the learners with high spatial ability, (2) for the learners with low spatial ability, learning was enhanced by the use of animations, (3) merely adding motion cues to the static visual representation did not improve learning of the learners with low spatial ability, and (4) use of animations did not help learners with low spatial ability more than those with high spatial ability.     

Strategic learning from expository animations: Short- and mid-term effects

In an experimental study, we investigated whether making use of a cognitive learning strategy (1) improves learning from different expository animations, (2) leads to an acquisition of knowledge which is available beyond the learning period, and (3) equally benefits students with low and high cognitive ability alike. A total of 152 sixth graders participated in the study: 69 students learned from an animation about the dances of honeybees and 83 students learned from an animation about sailing. With respect to both animations, the students who made use of the learning strategy significantly outperformed the students who had to write a summary. Effect sizes are medium to large. The beneficial effects of the learning strategy were also verified one week after the learning took place. The results of this study do not support the assumption that students with low and high cognitive ability benefit differently from the strategy.     

Learning hand manipulative tasks: When instructional animations are superior to equivalent static representations

Cognitive load theory was used to argue why instructional animations are more effective in teaching human motor skills than static representations. A key aspect to this argument is the role played by the transitory nature of animation and the newly discovered human mirror-neuron system. In two experiments students were taught to tie knots or complete puzzle rings either through an animated presentation or an equivalent sequence of static diagrams. In both experiments students learnt more from the animation mode than the static one, thus supporting the general thesis of the paper.     

Using animation to support the teaching of computer game development techniques

In this paper, we examine the potential use of animation for supporting the teaching of some of the mathematical concepts that underlie computer games development activities, such as vector and matrix algebra. An experiment was conducted with a group of UK undergraduate computing students to compare the perceived usefulness of animated and static learning materials for teaching such concepts. Undergraduate computer game development courses are currently a growing area of UK higher education. Computer game development can often involve the use of mathematical modelling of two-dimensional and three-dimensional computer game objects and their interactions. Overall, it appeared that animated learning materials appeared to be perceived as being more useful to undergraduate computer games students than traditional learning materials for learning such concepts.     

Learning cell biology with close-up views or connecting lines: Evidence for the structure mapping effect

Different visualization strategies for structuring non-hierarchical learning tasks in hypermedia are used until now. Do these strategies differ in learning effectiveness? In the present study, a hypermedia learning environment about cell biology was investigated. The graphical properties of a content module were created in two different ways, either depicting close-up views of the cell organelles or with connecting lines between the cell organelles and their respective technical terms within the graphic of the whole cell. Students’ post test performance indicate that connecting lines fostered auditory recall, that is remembering and understanding of narrative information, more efficiently than close-up views. In the case of visual recall, that is identification of electron microscopic pictures depicting cell structures, there was no difference in performance between these two visualization techniques. Transfer performance depended on an interaction between visualization technique and students’ spatial ability: Only students with high spatial ability benefited from the connecting lines variant. With respect to auditory recall and transfer performance, the present study supports the structure mapping effect as proposed by the integrated model of text and picture comprehension. Especially students with low spatial ability seem to be prone to an illusion of knowing.     

Using animation to help students learn computer algorithms

This paper compares the effects of graphical study aids and animation on the problem-solving performance of students learning computer algorithms. Prior research has found inconsistent effects of animation on learning, and we believe this is partly attributable to animations not being designed to convey key information to learners. We performed an instructional analysis of the to-be-learned algorithms and designed the teaching materials based on that analysis. Participants studied stronger or weaker text-based information about the algorithm, and then some participants additionally studied still frames or an animation. Across 2 studies, learners who studied materials based on the instructional analysis tended to outperform other participants on both near and far transfer tasks. Animation also aided performance, particularly for participants who initially read the weaker text. These results suggest that animation might be added to curricula as a way of improving learning without needing revisions of existing texts and materials. Actual or potential applications of this research include the development of animations for learning complex systems as well as guidelines for determining when animations can aid learning.     

Effects on learning of multimedia animation combined with multidimensional concept maps

This study investigates whether teaching materials combining multimedia animation and multidimensional concept maps (MAMCMs) improve learning achievement, retention, and satisfaction more than multidimensional concept maps (MCMs), as suggested by Huang et al. (2012) in Computers & Education. Learning retention, learning achievement, and learning satisfaction associated with two sets of course materials were compared in this quasi-experimental study. In total, 114 students from two classes at one private university in Taiwan participated in this 6-week teaching experiment. Analytical results indicate that learning achievement, learning satisfaction, and learning retention of the MAMCM group were better than those of the MCM group. Pedagogical implications and suggestions are given.     

Learning from instructional animations: How does prior knowledge mediate the effect of visual cues?

The purpose of this study was to investigate the effects of cueing and prior knowledge on learning and mental effort of students studying an animation with narration. This study employed a 2 (no cueing vs. visual cueing) × 2 (low vs. high prior knowledge) between‐subjects factorial design. The results revealed a significant interaction effect between prior knowledge and cueing on learning. Low prior knowledge learners had higher scores after studying an instructional animation with visual cues, compared to those who studied the same instructional animation without visual cues. Conversely, when cues were not provided, high prior knowledge learners outperformed those high prior knowledge learners who studied with the cued version of an instructional animation. These results indicated that the effects of cueing in an instructional animation change depending on the learners' level of prior knowledge. Specifically, low prior knowledge learners benefited more when visual cues were provided, whereas cues did not facilitate learning for high prior knowledge learners.     

Can differences in learning strategies explain the benefits of learning from static and dynamic visualizations?

The effects of dynamic and static visualizations in understanding physical principles of fish locomotion were investigated. Seventy-five students were assigned to one of three conditions: a text-only, a text with dynamic visualizations, or a text with static visualizations condition. During learning, subjects were asked to think aloud. Learning outcomes were measured by tests assessing verbal factual knowledge, pictorial recall as well as transfer. Learners in the two visualization conditions outperformed those in the text-only condition for transfer and pictorial recall tasks, but not for verbal factual knowledge tasks. Analyses of the think-aloud protocols revealed that learners had generated more inferences in the visualization conditions as opposed to the text-only condition. These results were mirrored by students’ self-reported processing demands. No differences were observable between the dynamic and the static condition concerning any of the learning outcome measures. However, think-aloud protocols revealed an illusion of understanding when learning with dynamic as opposed to static visualizations. Furthermore, learners with static visualizations tended to play the visualizations more often. The results stress the importance of not only using outcome-oriented, but also process-oriented approaches to gain deeper insight into learning strategies when dealing with various instructional materials.