Benefits of adding anxiety-reducing features to a computer-based multimedia lesson on statistics

The present study examined the effectiveness of techniques intended to reduce anxiety as students learn mathematical content from a computer-based lesson. In a between-subjects experiment, students learned statistical rules through worked examples in a computer-based learning environment that either did (treatment group) or did not (control group) include anxiety reducing features—a coping message delivered through the lesson by an online pedagogical agent concerning how to manage feelings of anxiety, and prompts for expressive writing, in which students summarize their thoughts and feelings. An independent samples t-test showed that the treatment group, which received added anxiety-reducing features, showed higher accuracy than the control group on solving practice problems (d = 0.71) and retention problems (d = 0.63) and reported higher perceived effort on learning the multimedia lesson (d = 0.66). In addition, a standard multiple linear regression found that anxiety, self-efficacy, and cognitive load as a set predicted performance (R² = 0.56), with self-efficacy as the strongest predictor (β = 0.63). Adding anxiety-reducing features to an online lesson may encourage greater effort, which leads to better learning outcomes.     

The effect of the modality principle to support learning with virtual reality: An eye-tracking and electrodermal activity study

Background

Virtual reality (VR) is considered a promising approach to support learning. An instructional design is essential to optimize cognitive processes. Studies show that VR has unique instructional and pedagogical requirements.

Objectives

To evaluate the effectiveness and applicability of the modality principle, which was previously validated in 2D classic multimedia, for learning with VR. The modality principle states that multimedia information presented as spoken narration is superior to on-screen text.

Methods

A prospective experimental study with two compared conditions of instruction: VR-based learning guided by on-screen text (n = 34) versus spoken narration (n = 28). Students' cognitive learning experiences were captured by eye-tracking and electrodermal activity (EDA). In addition, students' knowledge was evaluated using a pre–post knowledge test.

Results and Conclusions

Overall, there was no significant difference in knowledge retention between the participants who learned with on-screen text compared to spoken narration. However, results from the eye-tracking analysis showed that students who learned with the on-screen text devoted longer visual attention toward important learning activity areas of interest, suggesting a better ability to discern between relevant and irrelevant information. Conversely, students who learned with the spoken narration expressed significantly more EDA peak responses, proposing a higher cognitive load.

Implications

This study outlines that while learning with VR was effective, the modality principle might not apply to learning with VR. Moreover, the analysis of the learning process suggests even an inverse effect, favouring the provision of instructional scaffolds as on-screen text. Future research should evaluate this effect on long-term knowledge retention.     

Using multimedia for e‐learning

This paper reviews 12 research‐based principles for how to design computer‐based multimedia instructional materials to promote academic learning, starting with the multimedia principle (yielding a median effect size of d = 1.67 based on five experimental comparisons), which holds that people learn better from computer‐based instruction containing words and graphics rather than words alone. Principles aimed at reducing extraneous processing (i.e., cognitive processing that is unrelated to the instructional objective) include coherence (d = 0.70), signalling (d = 0.46), redundancy (d = 0.87), spatial contiguity (d = 0.79) and temporal contiguity (d = 1.30). Principles for managing essential processing (i.e., mentally representing the essential material) include segmenting (d = 0.70), pre‐training (d = 0.46) and modality (d = 0.72). Principles for fostering generative processing (i.e., cognitive processing aimed at making sense of the material) include personalization (d = 0.79), voice (d = 0.74) and embodiment (d = 0.36). Some principles have boundary conditions, such as being stronger for low‐ rather than high‐knowledge learners.     

Cognitive consequences of making computer-based learning activities more game-like

Some students (base group) played the Circuit Game, a 10-level computer-based learning activity intended to help students learn how electrical circuits work. Other students (competition group) played the same game but with competition features added - including a score bar showing performance on each level, the opportunity to earn one ticket per level if a performance criterion is met, and the opportunity to win a prize based on the number of tickets earned. On a retention test given after the game, the competition group remembered significantly more than the base group (d = 0.47). On an embedded transfer test constituting the final level of the game, the groups did not differ significantly. However, on the transfer test there was a significant gender by group interaction in which men performed worse in the competition group than the base group (d = −0.54) and women performed better in the competition group than the base group (d = 0.24). Overall, adding game-like features to a computer-based learning activity caused students to pay attention to game details but did not motivate students - particularly men - to learn more deeply.     

Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments

The main objective of this study was to examine the effectiveness of immersive virtual reality (VR) as a medium for delivering laboratory safety training. We specifically compare an immersive VR simulation, a desktop VR simulation, and a conventional safety manual. The sample included 105 first year undergraduate engineering students (56 females).  We include five types of learning outcomes including post‐test enjoyment ratings; pre‐ to post‐test changes in intrinsic motivation and self‐efficacy; a post‐test multiple choice retention test; and two behavioral transfer tests. Results indicated that the groups did not differ on the immediate retention test, suggesting that all three media were equivalent in conveying the basic knowledge. However, significant differences were observed favoring the immersive VR group compared to the text group on the two transfer tests involving the solving problems in a physical lab setting (d = 0.54, d = 0.57), as well as enjoyment (d = 1.44) and increases in intrinsic motivation (d = 0.69) and self‐efficacy (d = 0.60). The desktop VR group scored significantly higher than the text group on one transfer test (d = 0.63) but not the other (d= 0.11), as well as enjoyment (d =1.11) and intrinsic motivation (d =0.83).     

Engaging middle school students in scientific practice with a collaborative mobile game

Previous research using collaborative mobile augmented reality games in science education revealed that such games can be used to promote learner engagement and have found that engagement in such mobile games is related to flow. This study investigated whether player's flow experience differed by achievement track, gender, or gender composition of working groups. In an urban school district, 202 students from two eighth‐grade science classes participated in a collaborative mobile science game. Data included a self‐report survey collected after the game that measured player's flow experience. Using a regression model, the relationship of flow experience with achievement track and gender was explored while controlling for group composition and teacher effects. The study found that gender was related to flow experience; specifically, girls reported higher flow experience scores (d = 0.30). Flow experience did not have a statistically significant relationship with achievement track showing that the activity engaged all observed students similarly.     

Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation

The aim of this study was to assess the learning effectiveness and motivational appeal of a computer game for learning computer memory concepts, which was designed according to the curricular objectives and the subject matter of the Greek high school Computer Science (CS) curriculum, as compared to a similar application, encompassing identical learning objectives and content but lacking the gaming aspect. The study also investigated potential gender differences in the game’s learning effectiveness and motivational appeal. The sample was 88 students, who were randomly assigned to two groups, one of which used the gaming application (Group A, N = 47) and the other one the non-gaming one (Group B, N = 41). A Computer Memory Knowledge Test (CMKT) was used as the pretest and posttest. Students were also observed during the interventions. Furthermore, after the interventions, students’ views on the application they had used were elicited through a feedback questionnaire. Data analyses showed that the gaming approach was both more effective in promoting students’ knowledge of computer memory concepts and more motivational than the non-gaming approach. Despite boys’ greater involvement with, liking of and experience in computer gaming, and their greater initial computer memory knowledge, the learning gains that boys and girls achieved through the use of the game did not differ significantly, and the game was found to be equally motivational for boys and girls. The results suggest that within high school CS, educational computer games can be exploited as effective and motivational learning environments, regardless of students’ gender.     

Social presence in relation to students' satisfaction and learning in the online environment: A meta-analysis

Social presence, the ability to perceive others in an online environment, has been shown to impact student motivation and participation, actual and perceived learning, course and instructor satisfaction, and retention in online courses; yet very few researchers have attempted to look across contexts, disciplinary areas, or measures of social presence. This meta-analysis allowed us to look across these variables of the primary studies and identify the pattern of student outcomes (e.g., perceived learning and satisfaction) in relation to social presence through scrutiny of differences between the studies. The results showed a moderately large positive average correlation between social presence and satisfaction (r = 0.56, k = 26) and social presence and perceived learning (r = 0.51, k = 26). Large variation among correlations (86.7% for satisfaction and 92.8% for perceived learning, respectively) also indicated systematic differences among these correlations due to online course settings. We found that (a) the strength of the relationship between social presence and satisfaction was moderated by the course length, discipline area, and scale used to measure social presence; and (b) the relationship between social presence and perceived learning was moderated by the course length, discipline area, and target audience of the course. Implications and future research are discussed.     

Platform is not destiny: Embodied learning effects comparing 2D desktop to 3D virtual reality STEM experiences

Experiences in immersive 3D virtual reality (VR) are more presence-inducing, and so it may be tempting to claim that content will be learned better in VR. This randomized control trial study on natural selection challenges that assumption. This study answers the question of whether learning STEM in an immersive 3D VR environment is always superior to learning via a 2D monitor (PC). This is a 2 × 2 × 3 design. The first factor is platform immersivity (low = 2D PC, or high = 3D VR), the second factor is level of embodiment (lower = watching playback video, or higher = using mouse/controller to agentically manipulate content), and the third factor is test time (pretest, posttest, and follow-up). There was a significant main effect for embodiment, the high embodied and agentic groups learned the most. There was not a main effect for platform, because the participants in the low embodied VR group performed significantly worse than the three other groups. Although, the one high embodied, VR group learned and retained the most knowledge. A path-analysis revealed that the effect of platform was significantly mediated by presence, agency, and engagement. The smaller learning gain in the low embodied VR condition suggests that participants come to the immersive VR experience with expectations about agency and control of the virtual content, and when those expectations were not met, the disconnect was deleterious for learning. More agentic and interactive control of manipulable virtual content is encouraged. Design is critical, and platform is not destiny.     

Instructional effectiveness of a computer-supported program for teaching reading comprehension strategies

This article examines the effectiveness of a computer-based instructional program (e-PELS) aimed at direct instruction in a collection of reading comprehension strategies. In e-PELS, students learn to highlight and outline expository passages based on various types of text structures (such as comparison or cause-and-effect) as well as to paraphrase, self-question, and summarize. The study involved 1041 fourth-grade elementary students from 21 schools distributed in three regions in central Chile. Participant teachers integrated this program into the Spanish language curriculum, instructing their students during thirty sessions of 90 min each during one school semester. Pretest-to-posttest gains in reading comprehension scores were significantly greater for students instructed with this program than for students who received traditional instruction (d = .5), with particularly strong effects for lower-achieving students (d = .7). The findings support the efficacy of direct instruction in specific learning strategies in a computer-based environment.     

Computer game development as a literacy activity

This study examined computer game development as a pedagogical activity to motivate and engage students in curriculum-related literacy activities. We hypothesized that as a consequence, students would improve their traditional reading and writing skills as well as develop new digital literacy skills. Eighteen classes of grade 4 students were assigned to either an experimental or control group. Both groups studied the same curriculum unit over a 10 week period, however, in addition the experimental group developed computer games related to the unit using a game development shell. An analysis of pre- and post-unit scores on two standardized literacy test batteries revealed that the experimental students performed significantly better on one of the subtests, a measure of logical sentence construction (p = .002). Field notes and teacher interview data indicated that game development helped improve student content retention, ability to compare and contrast information presented, utilize more and different kinds of research materials including digital resources, editing skills, and develop an insight into questioning skills.     

Do zoom meetings really help? A comparative analysis of synchronous and asynchronous online learning during Covid-19 pandemic

Background

Online learning and teaching were globally popularized due to the impact of Covid-19. The pandemic has made both synchronous and asynchronous online learning inevitable in regions privileged with the technological affordance.

Aims

This study was designed to examine and compare the effectiveness of both learning modes through the Community of Inquiry framework.

Materials & Methods

Comparative analyses on a sample of N = 170 undergraduate students who took both synchronous and asynchronous online courses in Spring 2021.

Results

The paired-sample T-tests results indicated a significant difference in social presence, cognitive presence and self-evaluated performance.

Discussion & Conclusion

Teaching presence significantly influenced social presence and cognitive presence in both learning modes. However, under synchronous learning mode, social presence significantly impacted self-evaluation, grades and school identification. While social presence only influenced school identification under asynchronous learning mode. Theoretical and practical implications were also included.     

Learning with quizzes,simulations, and adventures: Students' attitudes,perceptions and intentions to learn with different types of serious games

Students' attitudes, their perceptions of cognitive and affective quality as predictors of attitudes, and the resulting intention toward learning with serious games remains ambiguous, largely due to the use of imprecise measures. The presented studies have aimed to develop and test a measurement of students' attitudes, perceptions, and intentions to learn with serious games in general, and to use the instrument to examine differences for the most common types of serious games, that is quiz, simulation, and adventure. To this end, a pretest (n = 301) and two main studies (Study 1: n = 135, Study 2: n = 375) were conducted. The developed instrument shows high reliability and convergent validity. Results demonstrate positive attitudes, positive cognitive perceptions, and high positive and low negative affective perceptions of students toward learning with serious games in general, as well as with different game types. Findings from a multivariate analysis of variance (MANOVA), however, indicate differences between the three game types that could be related to the perceptions of cognitive and affective quality. Predominately, compared to quizzes and adventures, simulations were perceived as more supportive for the comprehension and application of knowledge while promoting a less positive affect. Additionally, there was a significant difference due to gender. Whereas females reported higher perceptions of negative affective quality compared to males when serious games were addressed in general, answers to questions about the specific game types revealed a more detailed picture. In contrast to previous findings in existing literature, female students reported a more positive attitude, as well as higher perceptions of positive affective quality, than males for all three game types. These results stress the importance of examining the types of serious games separately and considering gender when evaluating students' attitudes and perceptions when learning with serious games.     

Fostering multimedia learning of science: Exploring the role of an animated agent’s image

Research suggests that students learn better when studying a picture coupled with narration rather than on-screen text in a computer-based multimedia learning environment. Moreover, combining narration with the visual presence of an animated pedagogical agent may also encourage students to process information deeper than narration or on-screen text alone. The current study was designed to evaluate three effects among students learning about the human cardiovascular system: the modality effect (narration vs. on-screen text), the embodied agent effect (narration + agent vs. on-screen text), and the image effect (narration + agent vs. narration). The results of this study document large and significant embodied agent and image effects on the posttest (particularly retention items) but surprisingly no modality effect was found. Overall, the results suggest that incorporating an animated pedagogical agent – programmed to coordinate narration with gaze and pointing – into a science-focused multimedia learning environment can foster learning.     

Enhancing middle school students' scientific learning and motivation through agent‐based learning

Facing students' decreasing motivation to pursue scientific study, schools and educators need to coordinate new technologies with pedagogical agents to effectively sustain or promote students' scientific learning and motivation to learn. Although the provision of pedagogical agents in student learning has been studied previously, it is not clear what benefits the strategy might offer with regard to student motivation. This study proposes an agent‐based mechanism that integrates problem‐solving and inquiry‐based instructions to help students better understand complex scientific concepts and to sustain their motivation to learn science. In this study, a quasi‐experiment was conducted to evaluate the performance and feasibility of our proposed mechanism. The results revealed that the agent‐based mechanism was effective and feasible for enhancing students' learning and motivation to learn. The mechanism was associated with increases in the acquisition of knowledge when compared with the control group. Its effect in promoting and sustaining students' motivation was also statistically significant. Detailed discussions of the findings are provided in this study.     

Can video games change attitudes towards history? Results from a laboratory experiment measuring short- and long-term effects

This study investigates a video game's effects on implicit and explicit attitudes towards depicted historical events in the short- and long-term on a sample of 148 young adults. We used, as an intervention tool, a serious game Czechoslovakia 38–89: Borderlands that deals with the expulsion of the Sudeten Germans from the former Czechoslovakia after the WWII. Results showed more negative pretest-posttest explicit attitude changes towards the expulsion on a general level (d = −0.34) and a specific level (d = −0.53) compared to the control group. Over the long-term, group differences in attitude change remained significant for the specific level (d = −0.44), but not for general one (d = −0.16). Exploratory analysis on the item level indicated that especially attitudes towards the expulsion's (un)fairness were affected by the game. However, no significant changes were found in implicit attitudes in the experimental group. This study is the first of such scale to empirically investigate video games' effects on a society's historical awareness.     

The synergetic effect of learning styles on the interaction between virtual environments and the enhancement of spatial thinking

Students have difficulty learning 3D geometry; spatial thinking is an important aspect of the learning processes in this academic area. In light of the unique features of virtual environments and the influence of metacognitive processes (e.g., self-regulating questions) on the teaching of mathematics, we assumed that a combination of self-regulating questions and virtual environments would enhance spatial thinking through the exercise of certain spatial abilities with the VR Spaces 1.0 software. These two methods primarily focus on the cognitive domain. In terms of learning styles, we define different cognitive characteristics. The main objective of the present study was to examine whether students with a certain learning style would benefit more from this exercise than other students. To assess the effect of these methods, a sample of 192 10th graders were randomly assigned to four groups, two of which used Virtual Spaces 1.0 (Group 1 with virtual reality and self-regulating questions, N = 52; Group 2 with virtual reality only, N = 52) while the other two used non-Virtual Spaces 1.0 (Group 3 with self-regulating questions only, N = 45; Group 4 was the non-treatment group; N = 45). The findings indicate a differential impact of virtual environments on students with different modal and personal learning styles.     

‘Because it’s boring, irrelevant and I don’t like computers’: Why high school girls avoid professionally-oriented ICT subjects

The current paper details results from the Girls and ICT survey phase of a three year study investigating factors associated with low participation rates by females in education pathways leading to professional level information and communications technology (ICT) professions. The study is funded through the Australian Research Council’s (ARC) Linkage Grants Scheme. It involves a research partnership between Education Queensland (EQ), industry partner Technology One and academic researchers at (affiliation removed for review purposes). Respondents to the survey were 1453 senior high school girls. Comparisons were drawn between Takers (n = 131) and Non Takers (n = 1322) of advanced level computing subjects. Significant differences between the groups were found on four questions: “The subjects are interesting”; “I am very interested in computers”; “The subject will be helpful to me in my chosen career path after school”; and “It suited my timetable”. The research has demonstrated that senior high school girls tend to perceive advanced computing subjects as boring and they express a strong aversion to computers.     

Effectiveness of learning in online academic courses compared with face‐to‐face courses in higher education

This study examined the effectiveness of 3 online courses compared with the same 3 courses in a face‐to‐face (F2F) format, which had the same characteristics (e.g., the same instructor and final exam content and place). Effectiveness was examined by utilizing a wide range of variables, including 2 objective measures (N = 968): grades and completion rate; and 9 subjective measures (N = 360): 7 measures include instructional aspects (course structure, learning content, lessons watched, assignments, communication), engagement, and satisfaction. Findings indicate significant differences between online and F2F courses in most of the examined variables. Students in the online courses reported better understanding of the course structure, better communication with the course staff, watching the videos lessens more, and higher engagement and satisfaction. Students in the F2F courses reported better contribution of the learning content. Students' final grades were higher in the online courses, and no differences were found in the completion rate. The findings suggest that in many of the examined effectiveness aspects, online courses are as effective as, or more effective than, F2F courses. Interpretations of the findings are discussed.     

The effectiveness of a one-year online mentoring program for girls in STEM

Although the performance of girls in science, technology, engineering, and mathematics (STEM) is continually improving and is no longer below that of boys in most domains, girls' interests in STEM and participation rates are still too low. Online mentoring may help ameliorate this situation. To test this assumption, a one-year personal mentoring program for eleven to eighteen-year-old female college-preparatory students was evaluated. Mentee and mentor communicate with one another and with other program participants via email, online chat, and forums. To measure program effectiveness, we randomly assigned participants (N = 312) to either a treatment group (N = 208) or a waiting-list control group (N = 104). We collected questionnaire data at three points in time. In comparison to the waiting-list group, the treatment-group participants showed greater levels of desirable short-term and long-term developments. Our findings indicate various advantages for online mentoring for promoting girls' interests in STEM.