Developing a web‐based multimedia assessment system for facilitating science laboratory instruction

This study developed a web‐based multimedia assessment system (WMA system) and applied it to science laboratory instruction. The goal was to improve students' knowledge acquisition under science laboratory instruction. The developed system enabled learners to perform self‐assessments by responding to multimedia technology test items online. The system recorded each learner's complete answer history and provided the students with personalized learning resources. This study adopted a quasi‐experimental research design. The learning content was an “experiment on separating mixtures.” Students participating in the research were divided into a typical science laboratory instruction group (TI group; n = 25) and a group that received instruction through the WMA system (WMA group; n = 26). Before instruction, all the students completed the conceptual knowledge and experimental knowledge pretests. During instruction, the TI group watched the teacher's demonstration experiment, and the students then performed the experiment in a real laboratory. In the WMA group, after learning through the WMA system, the students also performed the experiment in a real laboratory. After instruction, all the students completed the conceptual knowledge and experimental knowledge posttests. The findings indicated that the students in the WMA group showed significantly higher improvements in their scientific conceptual knowledge and experimental knowledge.     

Scaffolding strategies for supporting middle school students’ online inquiry processes

Online inquiry, use of the Web as an information resource to inquire into science, has become increasingly common in middle schools in recent years. However, prior research has found that middle school students tend to use the Web in a superficial manner. To address the challenges that students face in online inquiry, we designed the Digital IdeaKeeper, a scaffolded software tool to help students engage in online inquiry through support for inquiry planning, information search, analysis, and synthesis. This study examined the differences between regular and IdeaKeeper-supported online inquiry performed by 8 pairs of sixth graders in naturalistic classroom settings. Analysis of 80 screen videos of students’ computer activities and conversations found that IdeaKeeper-supported online inquiry was more integrated, efficient, continuous, metacognitive, and focused. This study has important implications for designing online learning environments for middle school students.     

A cross‐cultural study of the effect of a graph‐oriented computer‐assisted project‐based learning environment on middle school students' science knowledge and argumentation skills

The purpose of this mixed‐methods study was to explore how seventh graders in a suburban school in the United States and sixth graders in an urban school in Taiwan developed argumentation skills and science knowledge in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application (GOCAA). A total of 42 students comprised the treatment condition and were engaged in a project‐based learning environment that incorporated a GOCAA. Of these 42 students, 21 were located in the United States and 21 were located in Taiwan. A total of 26 students comprised the control condition and were engaged in a project‐based learning environment without the GOCAA. Of these 26 students, 15 were in the United States and 11 were in Taiwan. In each country, verbal collaborative argumentation was recorded and the students' post‐essays were collected. A one‐way analysis of variance (ANOVA) was conducted for each measure of science knowledge about alternative energies. The results showed a significant treatment effect for the outcome of scientific explanation among U.S. students, while among Taiwanese students, a significant treatment effect on scientific facts was observed. A one‐way ANOVA was additionally conducted for each measure of argumentation skills and a significant treatment effect on counterarguments and rebuttals was observed among the U.S. students, while in Taiwan, a significant treatment effect on reasoning and rebuttals was observed. A qualitative analysis was conducted to examine how the GOCAA supported students' development of argumentation skills in different countries. This study found distinct argumentation patterns between the U.S. and Taiwanese intervention teams. Additionally, a distinct gender difference in the use of evidence and division of labour was noted when the Taiwanese teams were compared with the U.S. teams, which may be explained by cultural differences. This study concluded that, in both the United States and Taiwan, a project‐based learning environment incorporating a GOCAA was effective in improving students' science knowledge and developing their scientific argumentation skills.     

The effect of a graph‐oriented computer‐assisted project‐based learning environment on argumentation skills

The purpose of this quasi‐experimental study was to explore how seventh graders in a suburban school in the United States developed argumentation skills and science knowledge in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application. A total of 54 students (three classes) comprised this treatment condition and were engaged in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application, whereas a total of 57 students (three classes) comprised the control condition and were engaged in a project‐based learning environment without this graph‐oriented, computer‐assisted application. Verbal collaborative argumentation was recorded and the students' post essays were collected. A random effects analysis of variance (ANOVA) was conducted and a significant difference in science knowledge about alternative energies between conditions was observed. A multivariate analysis of variance (MANOVA) was conducted and there was a significant difference in counterargument and rebuttal skills between conditions. A qualitative analysis was conducted to examine how the graph‐oriented, computer‐assisted application supported students' development of argumentation skills and affected the quality of collaborative argumentation. The difference in argumentation structure and quality of argumentation between conditions might explain a difference in science knowledge as well counterargument and rebuttal skills (argumentation) between both conditions. This study concluded that a project‐based learning environment incorporating a graph‐oriented, computer‐assisted application was effective in improving students' science knowledge and developing their scientific argumentation skills.     

Improving diagrammatic reasoning in middle school science using conventions of diagrams instruction

Visual representations are essential for science understanding, but many students have poor diagrammatic reasoning skills. Previous research showed that teaching high school and college students about the conventions of diagrams (COD) can improve diagrammatic reasoning. In this study, middle school science students received COD instruction delivered as a classroom warm‐up using laptop computers, while control students received publisher‐developed warm‐up questions. Students receiving COD warm‐ups for 10 weeks (but not 4 weeks) improved their diagrammatic reasoning more than control students. Treatment students' answers were more accurate than control students' answers, especially on easy questions. The discourse of pairs of students during the warm‐ups showed that treatment students talked about the diagrams more and made more inferences and that this difference was greatest for easy questions. Results suggest that COD instruction can be initiated in middle school along with more formal science instruction, can be integrated into classroom routine using computer‐delivered warm‐ups, is helpful (if sustained) both for improving diagrammatic reasoning and for supporting learning science content and works at least in part by increasing students' engagement during routine work.     

Mobile‐Based micro‐Learning and Assessment: Impact on learning performance and motivation of high school students

Mobile‐based micro‐learning has gained a lot of attention lately, especially for work‐based and corporate training. It combines features of mobile learning and micro‐learning to deliver small learning units and short‐term learning activities. The current study uses the lens of the Self‐Determination Theory of motivation and proposes a series of Mobile‐Based micro‐Learning and Assessment (MBmLA) homework activities to improve high school students' motivation and learning performance in science. An experiment was conducted to evaluate the effectiveness of the proposed approach. One hundred and eight students of a senior‐level high school in Europe were randomly assigned into either a control condition (conventional paper‐based homework approach) or an experimental (MBmLA approach) condition. The study carried out for a period of 5 weeks. From the experimental results, it was found that, in comparison to the conventional paper‐based approach, the proposed MBmLA approach enhanced students' basic psychological needs of self‐perceived autonomy, competence, and relatedness and improved students' exam performance in terms of factual knowledge. Moreover, students self‐reported greater learning satisfaction with the mobile‐based microassessment and micro‐learning homework tasks. Implications on educational practices as well as future research are discussed.     

Promoting contextual vocabulary learning through an adaptive computer‐assisted EFL reading system

The study developed an adaptive computer‐assisted reading system and investigated its effect on promoting English as a foreign language learner‐readers' contextual vocabulary learning performance. Seventy Taiwanese college students were assigned to two reading groups. Participants in the customised reading group read online English texts, each of which was customised by the developed system to offer immediate and repeated meetings with previously encountered unknown words, while participants in the typical reading group read online texts without control on unknown word recurrence. After the 4‐week online reading treatment, the two groups of learners were tested by online immediate and delayed vocabulary tests, and the students from the customised reading group were also required to complete the questionnaire regarding system use. The results showed that the vocabulary mean scores from both immediate and delayed testing demonstrated significantly better results in word gain and word retention with the customised reading group and that the adaptive reading system was appealing for the students. The study demonstrated that by providing customised reading with word recurrence specific to individuals' unknown words, this adaptive computer‐assisted English as a foreign language reading system creates a more favourable condition for foreign language vocabulary growth.     

Motivational beliefs and perceptions of instructional quality: predicting satisfaction with online training*

Abstract Many would agree that learning on the Web – a highly autonomous learning environment – may be difficult for individuals who lack motivation and self‐regulated learning skills. Using a social cognitive view of academic motivation and self‐regulation, the objective of the present study was to investigate the relations between students' motivational beliefs, their perceptions of the learning environment and their satisfaction with a self‐paced, online course. Service academy undergraduates (n = 646) completed a questionnaire following online training. Pearson correlations indicate that task value, self‐efficacy and perceived instructional quality were significantly positively related to each other and to students' overall satisfaction with the self‐paced, online course. Additionally, results from a three‐step hierarchical regression reveal that task value, self‐efficacy and instructional quality were significant positive predictors of students' satisfaction; the final regression model accounted for approximately 54% of the variance in the outcome measure. These findings support and extend prior research in traditional classrooms and online education in university settings, indicating that military students' motivational beliefs about a learning task and their perceptions of instructional quality are related, in important ways, to their overall satisfaction with online instruction. Educational implications and suggestions for future research are discussed.     

A mixed methods assessment of students' flow experiences during a mobile augmented reality science game

Current studies have reported that secondary students are highly engaged while playing mobile augmented reality (AR) learning games. Some researchers have posited that players' engagement may indicate a flow experience, but no research results have confirmed this hypothesis with vision‐based AR learning games. This study investigated factors related to students' engagement – as characterized by flow theory – during a collaborative AR, forensic science mystery game using mobile devices. School Scene Investigators: The Case of the Stolen Score Sheets is a vision‐based AR game played inside the school environment with Quick Response codes. A mixed methods approach was employed with 68 urban middle school students. Data sources included pre‐ and post‐surveys, field observations and group interviews. Results showed that neither gender nor interest in science was an important predictor of variability in flow experience. Gaming attitude uniquely predicted 23% of the variance in flow experience. Student flow experience features included a flash of intensity, a sense of discovery and the desire for higher performance. The findings demonstrated a potential for mobile AR science games to increase science interest and help students learn collaboration skills. Implications for future research concerning mobile AR science games are discussed.     

Exploring students' learning effectiveness and attitude in Group Scribbles‐supported collaborative reading activities: a study in the primary classroom

Improving students' reading comprehension is of significance. In this study, collaborative learning supported by Group Scribbles (GS), a networked technology, was integrated into a primary reading class. Forty‐seven 10‐year‐old students from two 4th grade classes participated in the study. Experimental and control groups were established to investigate the effectiveness of GS‐supported collaborative learning in enhancing students' reading comprehension. The results affirmed the effectiveness of the intervention designed. In the experiment group, students' learning attitudes, motivation and interest were enhanced as well. Further analyses were done to probe students' interaction processes in the networked collaborative classroom and different collaboration patterns and behaviours were identified. Based on the findings obtained, implications for future learning design to empower L1 learning were elaborated.     

Effects of an intelligent web‐based English instruction system on students' academic performance

This research conducted quasi‐experiments in four middle schools to evaluate the long‐term effects of an intelligent web‐based English instruction system, Computer Simulation in Educational Communication (CSIEC), on students' academic attainment. The analysis of regular examination scores and vocabulary test validates the positive impact of CSIEC, and in most cases, the positive impact is statistically significant. The reliability is ensured by the spectrum of the students from Grade 1 to Grade 3 in three junior high schools and from Grade 1 to Grade 2 in one senior high school, and of the teachers with or without blended learning experience, as well as by the various school locations from rural to urban areas in four provinces of China. The learning content‐oriented design and the instant feedback feature of the web‐based system, as well as its regular integration into the English class, contributed to its reliable positive effect on students' learning performance in ordinary examinations. This is the research's implication for instructional design. The conclusion of this paper could serve as a reference to the technical feasibility and pedagogical benefit of regular usage of appropriate Computer Assisted Learning system in the mainstream subject of middle schools. The multiple quasi‐experiments in divergent school settings to ensure the results' reliability distinguish this research from previous ones that just implemented one single experiment in one school.     

The effects of participation,performance, and interest in a game‐based writing environment

We have observed that many computer‐supported writing environments based on pedagogical strategies have only been designed to incorporate the cognitive aspects, but motivational aspects should also be included. Hence, we theorize that integrating game‐based learning into the writing environment may be a practical approach that can facilitate student participation, not only helping students learn how to write, but also sustaining their willingness to write. In this study, we investigate the effects of the game‐based writing environment on improving students' participation, performance, and interest in writing. An experiment was conducted to compare the effectiveness of 2 approaches to writing in language arts at an elementary school. Two hundred forty‐five third grade students participated in the experiment over a period of 1 year. One hundred thirty‐nine students were assigned to an experimental group and learned with a game‐based writing environment, and 106 students were in the contrast group and learned with an online writing environment. The empirical results show that the game‐based writing environment can effectively promote students' writing participation, writing performance, interest in writing, as well as their perceptions of the use of educational self‐management games. Some implications of the experimental results are also discussed.     

Participation,interaction, and academic achievement in an online discussion environment

Though online writing can be beneficial for diverse students in out-of-school environments, there is little consensus on the value of its use in schools. This study examined the online discussion of 48 fifth-grade students and their teachers over the 2009–2010 school year in a public school with large numbers of English learners. We collected students' statewide standardized writing and reading test scores, as well as an archive of all participants' discussion threads during the school year. Students' participation and interaction pattern in the online discussion environment over a school year was examined using growth model analysis and social network analysis. The effect of students' participation on their academic achievement was analyzed using multiple regressions. The results suggest that well-designed online discussions among linguistically diverse upper elementary students can result in increased participation and interaction, leading to language and literacy development.     

Facilitating student-driven constructing of learning environments using Web 2.0 personal learning environments

Web 2.0 Personal Learning Environments (PLEs) are becoming a promising area of development in e-Learning. While enhancing students' control over the entire learning process including constructing learning environment appears to be an essential objective of introducing Web 2.0 PLEs to education, there is little consensus on how to attain this objective. In this paper a theory-informed model to facilitate students' engagement in constructing their learning environment using Web 2.0 PLEs is proposed and evaluated. The model consists of four components: student's control dimensions, student-centric instructional approaches, the learning potential of Web 2.0 tools and services, and technology enhanced learning activities. This model is used to conduct a design-based research in the context of a first grade class in a secondary school in the Netherlands consisting of 29 students (18 girls and 11 boys, aged 11–13 year). The results suggest that the model can facilitate students' engagement in constructing their learning environment through influencing communication between teacher and students, involving students in adding tools, resources, and people into their learning environment, and enhancing their feeling of ownership over their learning environment.     

The indirect effects of online social entertainment and information seeking activities on reading literacy

Research showed distinct effects of different online activities on reading literacy or learning outcomes; however, no explanation about this link was provided. The current study investigated the effects of two genres of online reading activities on reading literacy based on knowledge of metacognitive strategies in a mediation analysis. Participants were 87,735 fifteen-year-old students (49.8% girls) across 15 regions in the PISA 2009 dataset. We divided online reading activities into social entertainment and information-seeking activities and controlled for gender, socioeconomic status, and the availability of Information and Communication Technologies (ICT) at home and at school. The indirect effects of knowledge of metacognitive strategies helped to explain why social entertainment and information-seeking activities would predict reading literacy differently. More frequent information-seeking activities predicted better knowledge of metacognitive strategies, which in turn predicted better reading literacy, while more frequent social entertainment activities predicted poorer knowledge of metacognitive strategies, which in turn led to poorer reading literacy. Suggestions were made to guide students in engaging in more online information-seeking reading activities, and incorporate instruction of metacognitive strategies for both online and offline reading, thereby improving students' reading literacy in both printed and digital formats.     

An implementation of remote laboratory for secondary science education

This paper reports our classroom implementation of a new remote laboratory (RL) system, which was developed by using innovative ideas and methods for applying technology‐enhanced learning to secondary school science education (Grades 7–9 or Ages 12–14). The newly developed RL system, which involves 8 remote experiments, was tested with 32 secondary school students from a local public school in order to evaluate its usability, learning, and their perception. The present study was carried out by using a mixed research method, including a questionnaire survey (open‐ended questions) and interviews. The corresponding research tools were specifically developed to collect data on students' perceptions and the implementation issues of the RL system. The survey results revealed that there was no major refinement required for the RL system, which was good enough for further adoption in secondary science education because its methods used to conduct online experiments could (a) extend/enhance the existing practices (with virtual/simulation experiments only) of e‐learning and (b) largely induce students' favourable views and perceptions in their own learning. Besides, negative comments and suggestions for improvement were purposely collected during a follow‐up period with an aim to pinpoint any ways in which the RL system and its design could be refined. They turned out to be very minor and easily fixed, and so the refined RL system is educationally suitable for use in laboratory activities and demonstrations to enhance the learning and teaching of science within and outside the secondary school environment.     

Students' usability evaluation of a Web‐based tutorial program for college biology problem solving

The understanding of core concepts and processes of science in solving problems is important to successful learning in biology. We have designed and developed a Web‐based, self‐directed tutorial program, SOLVEIT, that provides various scaffolds (e.g., prompts, expert models, visual guidance) to help college students enhance their skills and abilities in solving problems in science. An initial version of SOLVEIT was used in this study. This paper details the features of SOLVEIT that are contextualized within the biological domains of evolution and ecology. A qualitative case study was conducted to evaluate the usability of the program. Selected students were recruited from an introductory biology course at a large public university in the south‐eastern United States. Data for this study were collected through the SOLVEIT database and semi‐structured interviews. The findings of this study demonstrate the potential of the program for improving students' problem solving in biology. Suggestions for the use of SOLVEIT and its further improvement and development are discussed, along with suggestions for future research. This study also provides more general guidance for researchers and practitioners who are interested in the design, development and evaluation of Web‐based tutorial programs in science education.     

Can more interactivity improve learning achievement in an online course? Effects of college students' perception and actual use of a course-management system on their learning achievement

This study aims to investigate how interactivity influence learners' use of interactive functions in the course-management system (CMS) and their online learning performance. A two-tier mediation framework is proposed to examine the mediating effects of different actual-use records concerning the CMS's interactive functions. Data are collected from 381 undergraduate students who enrolled in a general-education asynchronous online course from three universities in Taiwan. The results indicate that the relationships among students' self-reported use of interactive functions, students' perceptions of the usefulness of interactive functions, and students' actual-use logs have some direct influences on students' online learning performance (online-discussion scores, exam scores, and group-project scores). In addition, students' actual-use logs (the number of times of log-ins to the online course, the number of times students read learning materials, and the number of postings on the discussion board) have a mediated effect on students' self-reported frequency of logging into the CMS, students' self-reported frequency of using the learner–instructor/learner–learner interactive functions, and online learning performance. The findings and implications could constitute a useful guide for educational practitioners and designers concerned with the effective integration of interactivity into future online courses.     

Enhancing middle school students' scientific learning and motivation through agent‐based learning

Facing students' decreasing motivation to pursue scientific study, schools and educators need to coordinate new technologies with pedagogical agents to effectively sustain or promote students' scientific learning and motivation to learn. Although the provision of pedagogical agents in student learning has been studied previously, it is not clear what benefits the strategy might offer with regard to student motivation. This study proposes an agent‐based mechanism that integrates problem‐solving and inquiry‐based instructions to help students better understand complex scientific concepts and to sustain their motivation to learn science. In this study, a quasi‐experiment was conducted to evaluate the performance and feasibility of our proposed mechanism. The results revealed that the agent‐based mechanism was effective and feasible for enhancing students' learning and motivation to learn. The mechanism was associated with increases in the acquisition of knowledge when compared with the control group. Its effect in promoting and sustaining students' motivation was also statistically significant. Detailed discussions of the findings are provided in this study.