The effect of a graph‐oriented computer‐assisted project‐based learning environment on argumentation skills

The purpose of this quasi‐experimental study was to explore how seventh graders in a suburban school in the United States developed argumentation skills and science knowledge in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application. A total of 54 students (three classes) comprised this treatment condition and were engaged in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application, whereas a total of 57 students (three classes) comprised the control condition and were engaged in a project‐based learning environment without this graph‐oriented, computer‐assisted application. Verbal collaborative argumentation was recorded and the students' post essays were collected. A random effects analysis of variance (ANOVA) was conducted and a significant difference in science knowledge about alternative energies between conditions was observed. A multivariate analysis of variance (MANOVA) was conducted and there was a significant difference in counterargument and rebuttal skills between conditions. A qualitative analysis was conducted to examine how the graph‐oriented, computer‐assisted application supported students' development of argumentation skills and affected the quality of collaborative argumentation. The difference in argumentation structure and quality of argumentation between conditions might explain a difference in science knowledge as well counterargument and rebuttal skills (argumentation) between both conditions. This study concluded that a project‐based learning environment incorporating a graph‐oriented, computer‐assisted application was effective in improving students' science knowledge and developing their scientific argumentation skills.     

Developing a survey for assessing preferences in constructivist context‐aware ubiquitous learning environments

This study developed a survey to explore students' preferences in constructivist context‐aware ubiquitous learning environments. A constructivist context‐aware ubiquitous learning (u‐learning) environment survey (CULES) was developed, consisting of eight scales, including ease of use, continuity, relevance, adaptive content, multiple sources, timely guidance, student negotiation, and inquiry learning. The survey responses were gathered from 215 university students from five universities in Taiwan. The students all had actual experience of using u‐learning systems in u‐learning environments. Both exploratory and confirmatory factor analyses showed that the CULES had high reliability and validity. The structural model revealed that the provision of realistic and close‐to‐real‐life information could enhance students' preferences for timely guidance, student negotiation, and inquiry‐learning activities. In addition, the attainment of inquiry learning is quite challenging when designing u‐learning activities, as it involves the enhancement of the other CULES scales.     

The effects of computerized inquiry‐stage‐dependent argumentation assistance on elementary students' science process and argument construction skills

This study proposed a computerized inquiry‐stage‐dependent argumentation assistance and investigated whether this can help improve elementary students' performance in science processes and the construction of quality arguments. Various argumentation assistances were developed and incorporated into each stage of scientific inquiry in a computer‐supported scientific inquiry system. A nonequivalent quasi‐experimental design was adopted to evaluate the effectiveness of this approach. Two intact sixth grade classes (N = 55) participated in this study, and each student used a tablet computer to accomplish the designated inquiry activities. One class of students was arranged to use the stage‐dependent argumentation assistance, and the other used a generic text‐based interface. The findings indicate that students who used the stage‐dependent argumentation assistance could acquire significantly better science process and argument construction skills than those using the generic text‐based interface.     

Using U‐Pace instruction to improve the academic performance of economically disadvantaged undergraduates

This study was undertaken to evaluate whether the student success associated with the U‐Pace instructional approach, which integrates mastery‐based learning with proactive instructor support in an online learning environment, would replicate for both economically disadvantaged students and students who are not economically disadvantaged. Undergraduates were enrolled in U‐Pace (intervention) or comparison sections of a gateway course at two universities with different learning management systems. Course content was held constant. At both universities, intervention students earned a significantly greater percentage of objectively determined final grades of A or B. This academic success was found for both economically disadvantaged intervention students and intervention students who were not economically disadvantaged. Improvement from the beginning to the end of the semester in intervention students' rate of mastering concepts was found at University 1, but not at University 2. The assessment of learning conducted at University 1, independent of final course grades, showed that intervention students scored significantly higher on the proctored cumulative exam than comparison students. Findings suggest that the U‐Pace instructional intervention holds promise for increasing the success of undergraduates regardless of economic status.     

Studying the effectiveness of an online argumentation model for improving undergraduate students' argumentation ability

This research develops a web-based model, entitled the “intuitive claim, peer-assessment, discussion, and elaborate claim argumentation training” (IPadE) model, and embeds with a Web-based Interactive Argumentation System to enhance undergraduate students' socioscientific argumentation abilities. This research adopts a quasi-experimental research design; the sample comprised 131 undergraduate students from two classes (69 in the experimental group and 62 in the control group). The socioscientific issue discussed were related to global health. This study collected and analysed quantitative and qualitative data, including the pretest and posttest of students' knowledge test scores and argumentation abilities questionnaire. The results generally confirmed the effectiveness of the IPadE model. First, in a comparison of the content knowledge and argumentation skills, the experimental group have statistically significantly improved than the control group. Second, regarding the number of reasoning modes proposed, the experimental group could propose multiple reasoning modes and reasoning levels on rebuttals increased after training.     

Early identification of ineffective cooperative learning teams

Cooperative learning has many pedagogical benefits. However, if the cooperative learning teams become ineffective, these benefits are lost. Accordingly, this study developed a computer‐aided assessment method for identifying ineffective teams at their early stage of dysfunction by using the Mahalanobis distance metric to examine the difference between the sequential test scores of the unknown team and the test scores of a reference group of functioning teams. The effectiveness of the proposed method was verified by conducting field experiments over an 18‐week engineering course in Taiwan. Forty‐eight students were randomly assigned to cooperative learning teams. The students' learning performance was evaluated by means of unit tests and homework tests. The functioning of the cooperative teams was examined at seven different points during the course of the study. The ineffective teams were identified with quantified type I errors. It was found that some teams failed persistently. Such teams require some form of external intervention to remedy the group dynamics. The results also showed that teams can become ineffective at any stage of the cooperative learning process. Thus, continuous monitoring is required to ensure that appropriate remedial actions are taken in a timely manner.     

Students' usability evaluation of a Web‐based tutorial program for college biology problem solving

The understanding of core concepts and processes of science in solving problems is important to successful learning in biology. We have designed and developed a Web‐based, self‐directed tutorial program, SOLVEIT, that provides various scaffolds (e.g., prompts, expert models, visual guidance) to help college students enhance their skills and abilities in solving problems in science. An initial version of SOLVEIT was used in this study. This paper details the features of SOLVEIT that are contextualized within the biological domains of evolution and ecology. A qualitative case study was conducted to evaluate the usability of the program. Selected students were recruited from an introductory biology course at a large public university in the south‐eastern United States. Data for this study were collected through the SOLVEIT database and semi‐structured interviews. The findings of this study demonstrate the potential of the program for improving students' problem solving in biology. Suggestions for the use of SOLVEIT and its further improvement and development are discussed, along with suggestions for future research. This study also provides more general guidance for researchers and practitioners who are interested in the design, development and evaluation of Web‐based tutorial programs in science education.     

The effect of online argumentation upon students' pseudoscientific beliefs

This study investigated how the students' pseudoscientific beliefs could be lessened by using online argumentation. With the aid of an online argumentation system for argumentation instruction and activities for students during the experiment, 77 Taiwanese university students together with 71 Taiwanese high school students (148 students in total) took part in this study. A quasi-experimental design was adopted and quantitative analyses were conducted. The results showed that using an online argumentation system for argumentation instruction and activities could lessen students' pseudoscientific beliefs. The experimental group students were lower than their counterparts in terms of mean pseudoscientific beliefs in the post-test and delayed test. After the experimental group students went through the online argumentation, changes in the percentage of students believing in four out of ten pseudoscientific items reached significance. However, as pseudoscientific beliefs are dependent on the cultural background, generalization of the results in this present study may be limited by cultural context. Finally, this study proposed suggestions related to argumentation research and science instruction counteracting students' pseudoscientific beliefs.     

Designing a technology‐enhanced flipped learning system to facilitate students' self‐regulation and performance

In recent years, the flipped classroom has become prevalent in many educational settings. Flipped classroom adopts a pedagogical model in which short video lectures are viewed by students at home before class so that the teacher can lead students to participate in activities, problem‐solving, and discussions. Yet the design or use of technology that employs planned instructional strategies with sustainable support of self‐regulation is scant. We propose a technology‐enhanced flipped language learning system (Flip2Learn) that provides facilitation and guidance for learning performance and self‐regulation. A quasi‐experimental study was carried out to examine whether Flip2Learn could enhance college students' self‐regulatory skills and later contribute to the learning performance in the flipped classrooms. The results showed that Flip2Learn not only better prepared students for flipped classrooms but also better promoted learning performance compared to the conventional flipped classrooms. The results of this research advanced our understanding of the dynamics of flipped classrooms and represented a revolutionary new approach to the technology‐enhanced learning for flipped classrooms.     

Mobile‐Based micro‐Learning and Assessment: Impact on learning performance and motivation of high school students

Mobile‐based micro‐learning has gained a lot of attention lately, especially for work‐based and corporate training. It combines features of mobile learning and micro‐learning to deliver small learning units and short‐term learning activities. The current study uses the lens of the Self‐Determination Theory of motivation and proposes a series of Mobile‐Based micro‐Learning and Assessment (MBmLA) homework activities to improve high school students' motivation and learning performance in science. An experiment was conducted to evaluate the effectiveness of the proposed approach. One hundred and eight students of a senior‐level high school in Europe were randomly assigned into either a control condition (conventional paper‐based homework approach) or an experimental (MBmLA approach) condition. The study carried out for a period of 5 weeks. From the experimental results, it was found that, in comparison to the conventional paper‐based approach, the proposed MBmLA approach enhanced students' basic psychological needs of self‐perceived autonomy, competence, and relatedness and improved students' exam performance in terms of factual knowledge. Moreover, students self‐reported greater learning satisfaction with the mobile‐based microassessment and micro‐learning homework tasks. Implications on educational practices as well as future research are discussed.     

Perceptions of learning effectiveness in M‐learning: scale development and student awareness

The purpose of this study is to develop a multi‐dimensional scale to measure students' awareness of key competencies for M‐learning and to test its reliability and validity. The Key Competencies of Mobile Learning Scale (KCMLS) was determined via confirmatory factor analysis to have four dimensions: team collaboration, creative thinking, critical thinking and problem solving, and communication. The research subjects are 815 students from the elementary school that participate in M‐learning programme in Taiwan. The research results show that students have better self‐awareness in team collaboration and creative thinking, but have worse self‐awareness in critical thinking and problem solving. This study also found that there was no significant difference between genders in the KCMLS, but students who study in the schools that committed in M‐learning longer have higher awareness in all dimensions than students who study in the schools that committed to M‐learning in fewer years.     

Effects of simulation‐based learning on students' statistical factual,conceptual and application knowledge

The purpose of this study was to (1) examine the effects of a storyline on learners' factual, conceptual and application knowledge with the use of a simulation for teaching introductory statistical skills and to (2) explore students' subjective enjoyment of various learning activities often used in statistics education. In order to conduct the study, two versions of a simulation were developed that differed in the presence or absence of a storyline attribute. Sixty‐four graduate students were randomly assigned to one of the two intervention conditions. Both intervention groups demonstrated significantly higher learning gains after interacting with the simulation. Particularly, both simulation‐based interventions had a positive significant effect on the acquisition of application knowledge and skills. However, no significant differences between the intervention groups on any learning outcome explored in the study were found. Results also showed that students rated the simulation used in the study as a more enjoyable learning activity in comparison to reading a textbook, lecture or teamwork. Students from the simulation without a storyline intervention reported higher enjoyment than the other intervention group. Implications of the findings for understanding the instructional benefits and shortcomings of embedding a storyline in digital learning content are discussed.     

Implementation of Web‐based argumentation in facilitating elementary school students to learn environmental issues

This research develops a Web‐based argumentation system named the Web‐based Interactive Argumentation System (WIAS). WIAS can provide teachers with the scaffolding for argumentation instruction. Students can propose their statements, collect supporting evidence and share and discuss with peers online. This research adopts a quasi‐experimental design, applying WIAS to the teaching of environmental issues, including mudslides, global warming and nuclear power. Fifty‐seven elementary school fifth graders from two classes participated in this research. With each class as a unit, they were divided into the WIAS group (n = 30) and the traditional argumentation instruction (TAI) group (n = 27). Before research, all students took the pre‐test of the ‘achievement test for environmental issues (ATEI)’ and the ‘environmental literacy scale (ELS).’ Then all students received argumentation training and six classes of argumentation instruction. Students in the WIAS group performed argumentation in the WIAS, while those in the TAI group performed argumentation in a traditional classroom. After the six‐class argumentation instruction, all students took the post‐test of the ATEI and ELS. The results show that students in the WIAS group have significantly better learning effectiveness than those in the TAI group. Students in the WIAS group also exhibited significantly better improvement in their environmental literacy.     

Supervised machine learning in multimodal learning analytics for estimating success in project‐based learning

Multimodal learning analytics provides researchers new tools and techniques to capture different types of data from complex learning activities in dynamic learning environments. This paper investigates the use of diverse sensors, including computer vision, user‐generated content, and data from the learning objects (physical computing components), to record high‐fidelity synchronised multimodal recordings of small groups of learners interacting. We processed and extracted different aspects of the students' interactions to answer the following question: Which features of student group work are good predictors of team success in open‐ended tasks with physical computing? To answer this question, we have explored different supervised machine learning approaches (traditional and deep learning techniques) to analyse the data coming from multiple sources. The results illustrate that state‐of‐the‐art computational techniques can be used to generate insights into the "black box" of learning in students' project‐based activities. The features identified from the analysis show that distance between learners' hands and faces is a strong predictor of students' artefact quality, which can indicate the value of student collaboration. Our research shows that new and promising approaches such as neural networks, and more traditional regression approaches can both be used to classify multimodal learning analytics data, and both have advantages and disadvantages depending on the research questions and contexts being investigated. The work presented here is a significant contribution towards developing techniques to automatically identify the key aspects of students success in project‐based learning environments, and to ultimately help teachers provide appropriate and timely support to students in these fundamental aspects.     

The effects of participation,performance, and interest in a game‐based writing environment

We have observed that many computer‐supported writing environments based on pedagogical strategies have only been designed to incorporate the cognitive aspects, but motivational aspects should also be included. Hence, we theorize that integrating game‐based learning into the writing environment may be a practical approach that can facilitate student participation, not only helping students learn how to write, but also sustaining their willingness to write. In this study, we investigate the effects of the game‐based writing environment on improving students' participation, performance, and interest in writing. An experiment was conducted to compare the effectiveness of 2 approaches to writing in language arts at an elementary school. Two hundred forty‐five third grade students participated in the experiment over a period of 1 year. One hundred thirty‐nine students were assigned to an experimental group and learned with a game‐based writing environment, and 106 students were in the contrast group and learned with an online writing environment. The empirical results show that the game‐based writing environment can effectively promote students' writing participation, writing performance, interest in writing, as well as their perceptions of the use of educational self‐management games. Some implications of the experimental results are also discussed.     

Developing a diagnosis system of work‐related capabilities for students: A computer‐assisted assessment

A gap exists between students' employment needs and higher education offerings. Thus, developing the capability to meet the learning needs of students in supporting their future aspirations should be facilitated. To bridge this gap in practice, this study uses multiple methods (i.e., nominal group technique and instructional systems development) and robust tests (e.g., reliability and validity) to develop a diagnosis system of work‐related capabilities. The research participants are twofold. At the early stage, this study invites three professors and three senior Human Resources managers to join the panel and help this study develop required capabilities. At the design and implementation stages, the research participants are freshman students at a famous university in Taiwan. This system enables college students to evaluate their capability scores by comparing themselves with the performances of prior students. The diagnosis results not only help students make learning plans during their university education, but also assist educators in adjusting the structure of the curriculum. Future studies are invited to use or adapt the assessment of work‐related capabilities, as well as proposed system procedure and architecture this study developed.     

Social skills as predictors of communication,performance and quality of collaboration in project‐based learning

The assumption that social skills are necessary ingredients of collaborative learning is well established but rarely empirically tested. In addition, most theories on collaborative learning focus on social skills only at the personal level, while the social skill configurations within a learning group might be of equal importance. Using the integrative framework, this study investigates which social skills at the personal level and at the group level are predictive of task‐related e‐mail communication, satisfaction with performance and perceived quality of collaboration. Data collection took place in a technology‐enhanced long‐term project‐based learning setting for pre‐service teachers. For data collection, two questionnaires were used, one at the beginning and one at the end of the learning cycle which lasted 3 months. During the project phase, the e‐mail communication between group members was captured as well. The investigation of 60 project groups (N = 155 for the questionnaires; group size: two or three students) and 33 groups for the e‐mail communication (N = 83) revealed that personal social skills played only a minor role compared to group level configurations of social skills in predicting satisfaction with performance, perceived quality of collaboration and communication behaviour. Members from groups that showed a high and/or homogeneous configuration of specific social skills (e.g., cooperation/compromising, leadership) usually were more satisfied and saw their group as more efficient than members from groups with a low and/or heterogeneous configuration of skills.     

On-line synchronous scientific argumentation learning: Nurturing students' argumentation ability and conceptual change in science context

The purpose of this study is to examine the difference in effectiveness between two on-line scientific learning programs – one with an argumentation component and one without an argumentation component – on students' scientific argumentation ability and conceptual change. A quasi-experimental design was used in this study. Two classes of 8th grade students (the experimental group) received the on-line scientific argumentation learning program about chemical reaction, and the other two classes of 8th grade students (the control group) received the same on-line scientific learning program about chemical reaction, but without argumentation, for two weeks. All 140 students were administered the scientific conception test, conceptual change test, and argumentation test before, one week after, and eight weeks after learning. In addition, the experimental group students' on-line argumentation process was collected. Results showed that the students of the experimental group significantly outperformed the control group, regardless of scientific conceptions, conceptual change, and argumentation. Regression results indicated that hold of scientific conceptions is the best predicator for students' conceptual change, followed by argumentation ability. The quantity and quality of scientific arguments that students generated in a series of argumentation questions improved across the four topics. In addition, students also successfully changed their conceptions from pre- to post-driving questions across four topics. This clearly demonstrates that students' argumentation ability and conceptual change were both facilitated through receiving the on-line Synchronous Argumentation science learning program.     

The effects of collaborative teamwork on secondary science

Abstract This study investigated whether a collaborative team setting benefits secondary science learning in a network supported environment. Ninety-four 10th grade (ages 16-17) girl students, in two Earth Science classes in Taiwan, were assigned to two settings: collaborative teams and individuals . The students' scientific process skill development, attitude toward school science and attitude toward using and learning about computers were compared. It was found that both groups showed significant improvements in skills and attitudes. However, the students in the team situation did not demonstrate significantly better skills or attitudes than the students in the individual situation.