Fostering multimedia learning of science: Exploring the role of an animated agent’s image

Research suggests that students learn better when studying a picture coupled with narration rather than on-screen text in a computer-based multimedia learning environment. Moreover, combining narration with the visual presence of an animated pedagogical agent may also encourage students to process information deeper than narration or on-screen text alone. The current study was designed to evaluate three effects among students learning about the human cardiovascular system: the modality effect (narration vs. on-screen text), the embodied agent effect (narration + agent vs. on-screen text), and the image effect (narration + agent vs. narration). The results of this study document large and significant embodied agent and image effects on the posttest (particularly retention items) but surprisingly no modality effect was found. Overall, the results suggest that incorporating an animated pedagogical agent – programmed to coordinate narration with gaze and pointing – into a science-focused multimedia learning environment can foster learning.     

The impact of multimedia effect on science learning: Evidence from eye movements

This study examined how middle school students constructed their understanding of the mitosis and meiosis processes at a molecular level through multimedia learning materials presented in different interaction and sensory modality modes. A two (interaction modes: animation/simulation) by two (sensory modality modes: narration/on-screen text) factorial design was employed. The dependent variables included subjects’ pre-test, post-test, and retention-test scores, showing their understanding of mitosis and meiosis process at molecular level, as well as data of subjects’ eye-movement behavior. Results showed the group that received animation with narration allocated a greater amount of visual attention (number of fixations, total inspection time, and mean fixation duration) than the group that received animation with on-screen text, in both pictorial area and area of interest, which is consistent with students’ immediate and long-term retained learning of the processes of mitosis and meiosis. The group that received simulation with on-screen text allocated a greater amount of visual attention than the group that received simulation with narration, consistent with students’ immediate and retained learning. The group that received simulation with on-screen text also allocated a greater amount of visual attention than the group that received animation with on-screen text, consistent with students’ immediate and retained learning. This study adds empirical evidence of a direct correlation between the length of eye fixation behavior and the depth of learning. Moreover, it provides insight into the multimedia effect on students’ cognitive process through the use of eye fixation behavior evidence.     

Does cognitive load moderate the seductive details effect? A multimedia study

Several studies have shown that adding seductive details to instructional materials has a detrimental effect on learning. However, other studies have shown non-significant findings. The present study uses cognitive load theory as a theoretical framework to explain these controversial results in seductive details research. Using a 2 × 2 experimental design we asked a group of high-school students (N = 100) to learn about biology with a multimedia environment that manipulated the presence of seductive details (with vs. without) and the modality of the verbal information (high load, on-screen text vs. low load, narration). The findings showed that students’ learning performance was significantly higher when seductive details were presented under the low load condition (narration) as compared to all other conditions. The theoretical implications for understanding the effects of non-redundant and interesting, but irrelevant learning material are discussed and future research directions are presented.     

Extending multimedia research: How do prerequisite knowledge and reading comprehension affect learning from text and pictures

The present study aimed at extending research on multimedia design principles by investigating their validity as a function of learners’ reading comprehension and scientific literacy. Students (N = 125; age: M = 15.11 years) learned about cell reproduction during their regular Biology lessons in one of six conditions resulting from cross-varying multimedia (text only vs. text plus animations) and text modality (spoken vs. written vs. spoken and written). Recall and transfer were assessed immediately after learning and again 1 week later. Overall, adding animations to text as well as using spoken rather than written text improved only immediate recall; in addition, a multimedia effect for delayed recall was observed for learners with higher levels of scientific literacy. A redundant presentation of text proved harmful especially for delayed performance measures. Reading comprehension did not moderate multimedia design effects. Students with more suitable cognitive prerequisites were better able to maintain performance from the immediate to the delayed tests. Future multimedia research should further investigate the boundary conditions that moderate multimedia effectiveness.     

Cognitive and affective effects of seductive details in multimedia learning

The present study integrates cognitive and affective aspects of media processing in order to make an argument for reexamining the current cold cognition perspective in multimedia research in favor of a more integrative perspective. The Cognitive-Affective-Theory-of-Learning-with-Media (CATLM) assumes that students need to become motivated to make full use of their cognitive resources. Therefore, and even though seductive details (sds) are additional interesting but unnecessary pieces of information that do not conform with the coherence principle, their possible motivational role should not be dismissed. Using a 2 × 3-experimental design, participants (N = 123) were asked to learn about biology with multimedia instruction that manipulated modality (text vs. narration) and presence of seductive details (no-sds vs. textual-sds vs. narrated-sds). Results of variance analyses show a modality effect. In addition, moderated mediation analyses with the moderator modality and mediator situational interest confirm the affective mediation assumption with the following two conditional effects. A direct detrimental effect of seductive details on learning performance under the text-condition and an indirect compensatory effect under the narration-condition were shown.     

Does modality play a role? Visual‐verbal cognitive style and multimedia learning

The study presented in this paper aimed to examine the effect of visual and verbal cognitive style on learning from different types of visualization and modalities of explanatory text. Learning materials in the form of either computer‐based animation or a series of static pictures with written or spoken explanations were presented to 197 students. We found that a more developed visual cognitive style was related to a better learning outcome, when learning from a combination of static pictures and written text. Higher developed visualizers achieved poorer learning outcomes when learning with an animation and written text. The results are partially in line with an ability‐as‐compensator effect and the expertise reversal effect. Additionally, we found a modality effect as the versions with spoken text provided better results on learning outcome than the versions with written text regardless of the prominence of visual cognitive style. No significant interaction effects were found regarding verbal cognitive style.     

The impact of disfluency,pacing, and students’ need for cognition on learning with multimedia

In the current study, it was examined how learning with multimedia is affected by disfluency, pacing, and students’ need for cognition. Contrasting hypotheses were derived regarding how reducing the audio quality of spoken text by integrating hissing (disfluent) would affect learning outcomes. According to cognitive load theory, a disfluent audio quality should hamper learning, while according to disfluency theory, a disfluent audio quality should foster learning, especially when learning is self-paced. Moreover, self-paced learning should be particularly beneficial for learners with a high need for cognition (NFC). The hypotheses were tested in a 2 × 2-design, with quality of spoken text (regular vs. disfluent) and pacing (system-paced vs. self-paced) as independent variables and NFC as continuous variable. Supporting cognitive load theory, disfluent text decreased performance in a transfer and pictorial test. There was no significant interaction between spoken text quality and pacing. However, in line with previous research, self-pacing led to longer learning times and increased performance in a retention and in a transfer test. Moreover, results revealed that self-pacing had beneficial effects on understanding particularly for learners with a high NFC. This suggests that whether self-pacing of a multimedia instruction fosters understanding depends on learners’ specific cognitive prerequisites.     

The influence of text modality on learning with static and dynamic visualizations

In this study we investigated the influence of text modality on learning with static and dynamic visualizations in a dynamic domain, namely the physical principles underlying fish locomotion. A 2 × 2-design with type of visualization (static vs. dynamic) and text modality (spoken vs. written) as independent variables was used. Concerning learning outcomes, it was hypothesized that (1) learners presented with dynamic visualizations would outperform learners presented with static visualizations, (2) learners presented with spoken text would outperform learners presented with written text, and (3) an interaction between type of visualization and modality would occur: the superiority of dynamic over static visualizations was expected to be more pronounced for spoken compared to written text. Subjective cognitive load measures were assessed and expected to mirror the aforementioned pattern of learning outcomes in accordance with Cognitive Load Theory (i.e., higher extraneous cognitive load (ECL) related to lower learning outcomes). For transfer tasks, the first two hypotheses could be confirmed. However, there was no interaction. Moreover, ECL was rated higher by subjects when learning with static compared to dynamic visualizations, but there were no differences for ECL with respect to the text modality. The results are discussed within the framework of Cognitive Load Theory.     

The effects of time-compressed instruction and redundancy on learning and learners’ perceptions of cognitive load

Can increasing the speed of audio narration in multimedia instruction decrease training time and still maintain learning? The purpose of this study was to examine the effects of time-compressed instruction and redundancy on learning and learners’ perceptions of cognitive load. 154 university students were placed into conditions that consisted of time-compression (0%, 25%, or 50%) and redundancy (redundant text and narration or narration only). Participants were presented with multimedia instruction on the human heart and its parts then given factual and problem solving knowledge tests, a cognitive load measure, and a review behavior (back and replay buttons) measure. Results of the study indicated that participants who were presented 0% and 25% compression obtained similar scores on both the factual and problem solving measures. Additionally, they indicated similar levels of cognitive load. Participants who were presented redundant instruction were not able to perform as well as participants presented non-redundant instruction.     

Teaching genetics with multimedia results in better acquisition of knowledge and improvement in comprehension

The main goal of this study was to explore whether the use of multimedia in genetics instruction contributes more to students' knowledge and comprehension than other instructional modes. We were also concerned with the influence of different instructional modes on the retention of knowledge and comprehension. In a quasi‐experimental design, four comparable groups of 3rd and 4th grade high school students were taught the process of protein synthesis: group 1 was taught in the traditional lecture format (n = 112 students), group 2 only by reading text (n = 124 students), group 3 through multimedia that integrated two short computer animations (n = 115 students) and group 4 by text supplemented with illustrations (n = 117 students). All students received one pre‐test in order to estimate their prior knowledge, and two post‐tests in order to assess knowledge and comprehension immediately after learning and again after 5 weeks. Results showed that students comprising groups 3 and 4 acquired better knowledge and improved comprehension skills than the other two groups. Similar results were observed for retention of acquired knowledge and improved comprehension. These findings lead to the conclusion that better learning outcomes can be obtained by the use of animations or at least illustrations when learning genetics.     

Cognitive load and science text comprehension: Effects of drawing and mentally imagining text content

One hundred and eleven 10th graders read an expository science text on the dipole character of water molecules (ca. 1600 words). Reading instruction was varied according to a 2 × 2 experimental design with factors ‘drawing pictures of text content on paper’ (yes, no) and ‘mentally imagining text content while reading’ (yes, no). The results indicate that drawing pictures, mediated through increased cognitive load, decreased text comprehension and, thus, learning (d = −0.37), whereas mental imagery, although decreasing cognitive load, increased comprehension only when students did not have to draw pictures simultaneously (d = 0.72). No evidence was found that the effects were moderated by domain-specific prior knowledge, verbal ability, or spatial ability. The results are in line with cognitive theories of multimedia learning, self-regulated learning, and mental imagery as well as conceptions of science learning that focus on promoting mental model construction by actively visualizing the content to be learned. Constructing mental images seems to reduce cognitive load and to increase comprehension and learning outcome when the mental visualization processes are not disturbed by externally drawing pictures on paper, whereas drawing pictures seems to increase cognitive load resulting in reduced comprehension and learning outcome.     

Differential benefits of situated instructional prompts

Learners often neglect support (glossaries, help sites etc.) in computer-based learning environments since they experience it as an unrelated add-on. We assumed that prompts presenting situated instructional support would lead to an increased use of help sites and glossary. Further it was assumed that situated instructional support would lead to a higher cognitive load of learners, which causes differential learning outcomes depending on learners’ general domain knowledge. To scrutinise the differential effect of situated instructional prompts we conducted an experiment with 69 students (undergraduates vs. graduates). Students learned either with a learning environment with or without prompts. As expected, learning with prompts resulted in an increased support usage. Furthermore, two interaction effects occurred. (1) Graduates learned slightly better with a program including prompts whereas undergraduates performed better without prompts. (2) Undergraduates stated a higher perceived cognitive load if they learned with a program with situated instructional prompts. In the group of graduates no differences occurred concerning the perceived cognitive load. The results are interpreted within the framework of cognitive load theory.     

A comparison of temporal speech and text cueing in educational multimedia

This research focused on the prediction that children in their school setting would learn more from educational multimedia when critical information was presented as spoken instead of textual cues. Analyses of a study (n= 42) showed that 12‐year‐olds did not learn any more from temporal speech cueing than from temporal text cueing. The findings suggest that multimedia learning for children is a different kind of learning experience than for adults or older adolescents. The results indicate underdeveloped executive control of the referential connections in the children's working memory between reading screen text while listening to spoken cues, and between watching on‐screen animations play while listening to spoken cues. Further study is warranted. Implications may be derived for educational multimedia research in school settings.     

Modality and cueing in multimedia learning: Examining cognitive and perceptual explanations for the modality effect

The purpose of this study was to investigate the effects of modality (written text vs. spoken text) and visual cueing (low cueing vs. high cueing) on the learning and mental effort of participants studying a computer-based static diagram at their own pace. Participants were randomly assigned to four versions of the computer-based materials formed into a 2 × 2 factorial design by crossing modality with cueing. The results revealed a reverse modality effect, wherein participants studying written text outperformed those studying spoken text on tests of free recall, matching, comprehension, and spatial recall, but not mental effort. Information cueing did not significantly affect either performance or mental effort. These findings are discussed in the context of two popular explanations of the modality effect: the cognitive resources explanation and the perceptual resources explanation. The results were best explained from a perceptual resources viewpoint.     

Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms

The present eyetracking study examined the influence of emotions on learning with multimedia. Based on a 2 × 2 experimental design, participants received experimentally induced emotions (positive vs. neutral) and then learned with a multimedia instructional material, which was varied in its design (with vs. without anthropomorphisms) to induce positive emotions and facilitate learning. Learners who were in a positive emotional state before learning had better learning outcomes in comprehension and transfer tests and showed longer fixation durations on the text information of the learning environment. Although anthropomorphisms in the learning environment did not induce positive emotions, the eyetracking data revealed that learners' attention was captured by this design element. Hence, learners in a positive emotional state who learned with the learning environment that included anthropomorphisms showed the highest learning outcome and longest fixation on the relevant information of the multimedia instruction. Results indicate an attention arousing effect of expressive anthropomorphisms and the relevance of emotional states before learning.     

When graphics improve liking but not learning from online lessons

The multimedia principle states that adding graphics to text can improve student learning (Mayer, 2009), but all graphics are not equally effective. In the present study, students studied a short online lesson on distance education that contained instructive graphics (i.e., directly relevant to the instructional goal), seductive graphics (i.e., highly interesting but not directly relevant to the instructional goal), decorative graphics (i.e., neutral but not directly relevant to the instructional goal), or no graphics. Following instruction, students who received any kind of graphic produced significantly higher satisfaction ratings than the no graphics group, indicating that adding any kind of graphic greatly improves positive feelings. However, on a recall posttest, students who received instructive graphics performed significantly better than the other three groups, indicating that the relevance of graphics affects learning outcomes. The three kinds of graphics had similar effects on affective measures but different effects on cognitive measures. Thus, the multimedia effect is qualified by a version of the coherence principle: Adding relevant graphics to words helps learning but adding irrelevant graphics does not.     

Empirical comparisons of animation and narration in requirements validation

Increasingly powerful computing technology suggests an expansion of multimedia features in requirements engineering methods. It is not obvious, however, that techniques such as animation and narration would improve the effectiveness of communicating domain information to stakeholders for validation. Three principles from the cognitive theory of multimedia learning (CTML) are used to compare validation methods using animation and narration with more traditional methods using static diagrams and text. Results suggest animation and narration can have significant positive impact on the level of domain understanding attained by participants. In particular, narration yielded strongly significant results. While these results should be viewed as preliminary, they indicate a potential advantage in the use of narration and possibly animation in requirements validation. The results provide justification for further research on the integration of multimedia techniques in developing and validating requirements.     

When redundant on-screen text in multimedia technical instruction can interfere with learning

It is frequently assumed that presenting the same material in written and spoken form benefits learning and understanding. The present work provides a theoretical justification based on cognitive load theory, and empirical evidence based on controlled experiments, that this assumption can be incorrect. From a theoretical perspective, it is suggested that if learners are required to coordinate and simultaneously process redundant material such as written and spoken text, an excessive working memory load is generated. Three experiments involving a group of 25 technical apprentices compared the effects of simultaneously presenting the same written and auditory textual information as opposed to either temporally separating the two modes or eliminating one of the modes. The first two experiments demonstrated that nonconcurrent presentation of auditory and visual explanations of a diagram proved superior, in terms of ratings of mental load and test scores, to a concurrent presentation of the same explanations when instruction time was constrained. The 3rd experiment demonstrated that a concurrent presentation of identical auditory and visual technical text (without the presence of diagrams) was significantly less efficient in comparison with an auditory-only text. Actual or potential applications of this research include the design and evaluation of multimedia instructional systems and audiovisual displays.     

Integrating mobile multimedia into textbooks: 2D barcodes

The major goal of this study was to empirically compare text-plus-mobile phone learning using an integrated 2D barcode tag in a printed text with three other conditions described in multimedia learning theory. The method examined in the study involved modifications of the instructional material such that: a 2D barcode was used near the text, the learner scanned the tag with the camera on his/her mobile phone and reached the animation and narration on the mobile phone's screen. Using this method, we created a new approach that reinforces printed textbooks, which had the poorest retention and transfer results. The results suggest that supporting a printed textbook with camera-equipped mobile devices and 2D barcodes linked to supplemental information, may increase the effectiveness of learning.