Tool-use in a blended undergraduate course: In Search of user profiles

The popularity of today’s blended courses in higher education is driven by the assumption that students are provided with a rich toolset that supports them in their learning process. However, little is known on how students actually use these tools and how this affects their performance for the course. The current study investigates how students use the entire toolset at their disposal, whether tool-use patterns can be found and if these patterns affect performance for the course. Logging students (n = 156) actions throughout the content management system and registering students’ use of the face-to-face support in an undergraduate course, the study reveals large student differences and an underuse for some tool-types. Further to this, K-means cluster analysis reveals three distinct tool-use patterns or user profiles: the no-users, the intensive users and the incoherent users. These patterns are characterized by different tool-choices and even different use intensity among students. Evidence is retrieved that these tool-use differences are problematic since multivariate analysis of variance reveals significant performance effects. Hence, these results imply that not all students seem to profit from the learning affordances that are provided. Similar as evidence in controlled settings, the results suggest that learner control in using tools cannot be taken for granted. Consequently, this study legitimates more research into the influencing (student and context) variables that can explain these differences.     

Content Management Systems: Enriched learning opportunities for all?

This article examines the popular claim of Content Management Systems (CMSs) that providing a rich toolset and leaving the use under learner control is beneficial to learning. By means of a literature review, the current contribution examines whether all students are capable of using CMS tools so that their learning is enhanced. In contrast to what is assumed, the study conceptualizes tool use as a complex self-regulation strategy that cannot be taken for granted. Specifically, the article reviews empirical studies in relation to three topics: (a) personal agency in tool use, (b) performance effects of tool use and (c) influencing tool use variables. Findings reveal that not every student profited from the CMS learning opportunities; in multiple studies students differed in their tool use, and these differences had significant performance effects. Hence, these findings suggest that the pedagogical claim CMSs make is problematic. Besides this accumulated corpus of knowledge, the review revealed serious limitations in the retrieved studies which could hamper our findings. As a consequence, the review establishes a need for further research into students’ CMS tool use from an instructional design perspective. In addition to the theoretical framework, several directions for future research are given.     

The technical framework of interactive functions for course-management systems: Students’ perceptions,uses, and evaluations

This study explores the interactivity of course-management systems (CMSs). First, this study reviews the concepts of interactivity, interactivity dimension, and interaction type on the basis of related theories and studies. Second, this study analyzes the interactive functions attributable to the six major CMSs in Taiwan colleges and universities, and re-constructs a technical framework containing five interaction types, nine interactivity dimensions, and 83 possible interactive functions. This study has found that a total of 21 interactive functions were featured in the six CMSs, while six functions identified from theories and research were not. In terms of interaction type, the results indicate that these six CMSs possessed the highest percentage of possible interactive functions for facilitating human interactions (e.g., learner–learner interaction and learner–instructor interaction), followed by learner–interface interaction and learner–self interaction, with the lowest percentage corresponding to learner–content interaction. In terms of interactivity dimension, these six CMSs seemed more likely to feature a learner-centered design approach than a system-centered one. Also, this study conducted user surveys on students’ perceptions, use, and evaluation of these interactive functions. A total of 491 valid sets of data were collected from six CMS user groups. The results indicate that, for their online learning, students considered the function of “Assignment handling” to be the most known, frequently used, and useful function. In addition, students were well familiar with, and made use of, any functions that would help them monitor or track their learning process. Students required more content-related interactive functions than were currently available in CMSs. Last, the regression results indicate that the more positively the students perceived the CMS interactivity, the usefulness of CMS for learning, and the interactive functions, the more positively these students perceived their CMSs.     

Students’ experiences with collaborative learning in asynchronous Computer-Supported Collaborative Learning environments

This paper describes an explorative study carried out to gain response from distance students on their experiences with collaborative learning in asynchronous computer supported collaborative learning (CSCL) environments. In addition, this study also attempts to have a good grip of crucial aspects concerning collaborative learning. The study was undertaken among distance learners from the Open University of the Netherlands who were working in groups of 4–11 persons. During and after the course students’ experiences with collaborative learning were measured and after the course also students’ satisfaction with collaborative learning was assessed. The finding revealed that distance learners appreciate the opportunities to work collaboratively. They show positive experiences and are quite satisfied with collaborative learning. This study also sought to explore individuals as well as course characteristics that influenced aspects of collaborative learning, and to search aspects of collaborative learning that influenced students’ satisfaction. The findings suggested that a group product influences group process regulation and group cohesion influences students’ satisfaction with collaborative learning.     

Students’ perceptions of collaboration, self-regulated learning, and information seeking in the context of Internet-based learning and traditional learning

This study aims to investigate students’ perceptions of three aspects of learning - collaboration, self-regulated learning (SRL), and information seeking (IS) in both Internet-based and traditional face-to-face learning contexts. A multi-dimensional questionnaire was designed to evaluate each aspect in terms of perceived capability, experience, and interest. The analyses explore (1) potential differences of students’ perceptions between Internet-based and face-to-face learning environments and (2) potential differences in the three aspects in relation to learners’ attributes and the use of the Internet and enrollment in online courses. This study surveyed students in a higher education institute who had had experiences with Internet-based and face-to-face learning. The results showed that students perceived higher levels of collaboration (capability only), SRL (capability and experience) and IS (capability, interest, and experience) in Internet-based learning than in traditional learning environments. In terms of students’ education level, graduate students perceived higher levels of capabilities and interests in some of the aspects, than undergraduate students. In addition, for Internet-based learning, significant differences in collaboration and SRL were found derived from time spent on the Internet related to learning; and students’ perceptions of collaboration, SRL, and IS were all positively correlated to students’ online course-taking experience. Implications for online learning practices and instructor’s facilitation are discussed.     

Learning science via animated movies: Its effect on students’ thinking and motivation

Some researchers claim that animations may hinder students’ meaningful learning or evoke misunderstandings. In order to examine these assertions, our study investigated the effect of animated movies on students’ learning outcomes and motivation to learn. Applying the quantitative methodology, two pre- and post-questionnaires were administered: Science thinking skills and Motivation to learn science. Students’ overall achievement in science was examined by their report card scores. The research population (N = 1335) was divided into experimental (N = 926) and control (N = 409) groups from 11 elementary schools. Findings indicated that the use of animated movies promoted students’ explanation ability and their understanding of scientific concepts. Findings also indicated that students who studied science with the use of animated movies developed higher motivation to learn science, in terms of: self-efficacy, interest and enjoyment, connection to daily life, and importance to their future, compared to the control students. Following the definition of multimedia, the students who study with the use of animated movies, applied all three learning styles: visual, auditory and kinesthetic. The use of multimedia and the fact that the students were engaged in exploring new concepts, that were relevant to their daily life experiences, can explain the positive results.     

Team shared mental model as a contributing factor to team performance and students’ course satisfaction in blended courses

The purpose of the study was to examine how team shared mental model (SMM), team performance, and students’ course satisfaction change over time and how Team-SMM affects team performance and students’ course satisfaction. Forty-eight preservice teachers from two undergraduate blended courses participated in this study. The data were obtained via two online questionnaires (shared mental model instrument and Course Satisfaction Scale) administered throughout Spring 2010. Data analysis was conducted using repeated measures ANOVA and multiple linear regression techniques. Results indicated that Team-SMM and students’ course satisfaction changed slightly over time but the change was not statistically significant. Team performance increased significantly over the courses. Additionally, attitudes towards teammates and task were closely linked with effective team performance and students satisfaction. In the early stage of the courses, general team knowledge, resource, and environment explained a significant amount of variance in students’ course satisfaction.     

The effect of moderator’s facilitative strategies on online synchronous discussions

Moderators play an important role within a computer supported collaborative learning environment, and thus facilitative strategies and communication technology are nowadays used to enhance students’ learning. This study proposed facilitative strategies as a guide for students’ learning, and explored the influence of these strategies on the students’ online synchronous discussion. A total of 331 senior high school students from eight computer classes in northern Taiwan were recruited to participate in this study. They were randomly assigned into an experimental condition, with the moderators’ facilitation to complete online learning tasks, and the control condition without moderators’ support. To fulfill the goal of the research, four strategies—helping students focus on the main topic, facilitating students’ making argumentation, giving students positive feedback, and helping students sustain threaded discussion—were adopted to facilitate the online synchronous discussion in the experimental condition. According to the results of the content analysis, four group discussion patterns were revealed, including collaboration, centralization, partial contribution, and non-interaction. The findings suggest that the moderator helped enhance the collaboration pattern and increase the online participation rate. In addition, it was found that the strategies of helping students focus on the main topic and giving students positive feedback were frequently employed.     

Improving literacy and metacognition with electronic portfolios: Teaching and learning with ePEARL

Can an electronic portfolio that is both a multimedia container for student work and a tool to support key learning processes have a positive impact on the literacy practices and self-regulated learning skills of students? This article presents the findings of a yearlong study conducted in three Canadian provinces during the 2007–2008 school year initially involving 32 teachers and 388 students. Due to varying levels of implementation our final data set included 14 teachers and 296 students. Using a non-equivalent pre-test/post-test design, we found that grade 4–6 students who were in classrooms where the teacher provided regular and appropriate use of the electronic portfolio tool ePEARL (i.e., medium–high implementation condition, n = 7 classrooms and 121 students), compared to control students (n = 7 classrooms and 175 students) who did not use ePEARL, showed significant improvements (p < .05) in their writing skills on a standardized literacy measure (i.e., the constructed response subtest of the Canadian Achievement Test-4th ed.) and certain metacognitive skills measured via student self-report. The results of this study indicate that teaching with ePEARL has positive impacts on students’ literacy and self-regulated learning skills when the tool is used regularly and integrated into classroom instruction.     

Developing Web-based assessment strategies for facilitating junior high school students to perform self-regulated learning in an e-Learning environment

This research refers to the self-regulated learning strategies proposed by Pintrich (1999) in developing a multiple-choice Web-based assessment system, the Peer-Driven Assessment Module of the Web-based Assessment and Test Analysis system (PDA-WATA). The major purpose of PDA-WATA is to facilitate learner use of self-regulatory learning behaviors to perform self-regulated learning and in turn improve e-Learning effectiveness. PDA-WATA includes five main strategies: ‘Adding Answer Notes,’ ‘Stating Confidence,’ ‘Reading Peer Answer Notes,’ ‘Recommending Peer Answer Notes’ and ‘Querying Peers’ Recommendation on Personal Answer Notes’. Using these strategies, examinees are allowed to add answer notes to explain why they chose a certain option as the correct answer and state their confidence in their own answer and answer notes, for peers’ reference. In addition to reading peer answer notes, examinees can also recommend peer answer notes as valuable references. The recommendation information can also be queried by all examinees. Quasi-experimental design was adopted to understand the effectiveness of PDA-WATA in facilitating learner use of self-regulatory learning behaviors to perform self-regulated learning and in improving learner e-Learning effectiveness. Participants were 123 seventh-grade junior high school students from four classes. These four classes were randomly divided into the PDA-WATA group (n = 63) and the N-WBT group (n = 60). Before e-Learning instruction, all students took the pre-test of the Learning Process Inventory (LPI), used to understand how often learners use self-regulatory learning behaviors in the learning process, and the pre-test of the summative assessment. After a two-week e-Learning instruction, the students all took the post-test of the LPI and the summative assessment. Results indicate that students in the PDA-WATA group appear to be more willing to take the Web-based formative assessment than students in the N-WBT group. In addition, PDA-WATA appears to be significantly more effective than N-WBT in facilitating learner use of self-regulatory learning behaviors to perform self-regulated learning and in improving their e-Learning effectiveness. Moreover, this research also finds that in the PDA-WATA group, there is no significant difference between the learning effectiveness of students with a low level of self-regulated learning and students with a high level of self-regulated learning, but similar result cannot be found in the N-WBT group.     

Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation

The aim of this study was to assess the learning effectiveness and motivational appeal of a computer game for learning computer memory concepts, which was designed according to the curricular objectives and the subject matter of the Greek high school Computer Science (CS) curriculum, as compared to a similar application, encompassing identical learning objectives and content but lacking the gaming aspect. The study also investigated potential gender differences in the game’s learning effectiveness and motivational appeal. The sample was 88 students, who were randomly assigned to two groups, one of which used the gaming application (Group A, N = 47) and the other one the non-gaming one (Group B, N = 41). A Computer Memory Knowledge Test (CMKT) was used as the pretest and posttest. Students were also observed during the interventions. Furthermore, after the interventions, students’ views on the application they had used were elicited through a feedback questionnaire. Data analyses showed that the gaming approach was both more effective in promoting students’ knowledge of computer memory concepts and more motivational than the non-gaming approach. Despite boys’ greater involvement with, liking of and experience in computer gaming, and their greater initial computer memory knowledge, the learning gains that boys and girls achieved through the use of the game did not differ significantly, and the game was found to be equally motivational for boys and girls. The results suggest that within high school CS, educational computer games can be exploited as effective and motivational learning environments, regardless of students’ gender.     

Understanding adolescents’ problematic Internet use from a social/cognitive and addiction research framework

As Internet usage has become more prevalent among youth, so too has problematic Internet use. Despite the critical role of emotion regulation in the development of adolescents’ behaviors and the role of parenting interactions on their children’s behaviors, little research has examined these links with reference to problematic and addictive Internet use for adolescents. The main goal of this study was to examine these links, based on a sample of 525 high school students (368 males; M = 15.33 years, SD = 0.47) from a predominantly middle and lower-middle socioeconomic community in Seoul, Korea. Results from structural equation modeling revealed that students’ difficulties in emotion regulation was a mediating variable between students’ perceptions of their parents’ parenting behaviors and the students’ Internet use. The findings substantiate the importance of conceptualizing addiction from a social/cognitive theoretical framework and the notion that adolescence is the onset period for many addictive behaviors and so more proactive attention needs to be given to reducing these early negative behaviors. Based on these results, interventions designed to enhance adolescents’ emotion regulatory abilities have the likelihood to mitigate problematic and even addictive Internet use among youth.     

Assessing tenth-grade students’ problem solving ability online in the area of Earth sciences

This study examined tenth-grade students’ (n = 263) problem solving ability (PSA) online through assessing students’ domain-specific knowledge (DSK) and reasoning skills (RS) in Earth sciences as well as their attitudes toward (AT) Earth sciences related topics in a secondary school of Taiwan. The students’ PSA was evaluated based on a previous model (Chang, C. Y. (2004, November 26–27). Trends in assessing student earth science problem solving ability: the importance of domain-specific knowledge and reasoning skills in earth sciences. Paper presented at the Seoul Conference for International Earth Science Olympiad (IESO), Seoul, Korea; Chang, C. Y., & Barufaldi, J. P. (submitted). Does problem solving = prior knowledge + reasoning skills in science? An exploratory study. Journal of Experimental Education; Chang, C. Y., & Weng, Y. H. (2002). An exploratory study on students’ problem-solving ability in earth science. International Journal of Science Education, 24(5), 441–452) which empirically established that students’ PSA is a composite of DSK, RS and AT subscales. Major findings are as follows: (a) The correlation coefficient among students’ DSK, RS and AT was relatively small, indicating that these subscales might have successfully represented different constructs of students’ PSA; (b) a significantly positive correlation existed between students’ PSA total scores and each subscale. It is, therefore, suggested that students’ PSA may be potentially assessed online by measuring their essential components in the area of Earth sciences.     

A study of the relationships among learning styles, participation types, and performance in programming language learning supported by online forums

This study is focused on the relationships among learning styles, participation types, and learning performance for programming language learning supported by an online forum. Kolb’s learning style inventory was used in this study to determine a learner’s learning type: ‘Diverger’, ‘Assimilator’, ‘Converger’, and ‘Accommodator’. Social Learning Theory was also used to define four participation types. These types in turn were used to describe the learning associated with the use of online forums: ‘Replier’, ‘Asker’, ‘Watcher’, and ‘No activity’.A total of 144 students participated in this experiment as part of a half semester ASP.NET programming language learning courses. The course contained an online forum for supporting the students’ social activities and participation. In this study, ‘learning score’ and ‘satisfaction’ were used to measure learning performance.The results of this study were the following: (1) different learning styles were associated with significantly different learning scores and that the ‘Accommodator’ style was associated with superior learning scores; (2) participation types were also associated with significantly different learning scores and that the ‘Replier’ type is associated with superior learning scores; (3) learning satisfaction is not significantly different among the different learning styles or different participation types, but the average is significantly higher than average values (3.5) of 7-point Likert scale; (4) there is no significant association between learning styles and participation types. Explanations and discussions of these results are offered.Based on the results of this study, we propose that programming language learning, supported with online forums and students’ active participation, increases learning performance as measured by student learning scores.     

Tracing elementary school students’ study tactic use in gStudy by examining a strategic and self-regulated learning

This study investigated, with the help of log file traces (f = 172), how 20 elementary school students used study tactics when studying science within the gStudy learning environment and examined how tactic use contributed to the students’ achievement. The analysis of this study is divided into two parts. First, at the situational level, the focus is on capturing the tactics that were used in different gStudy sessions, classifying the gStudy sessions based on the tactic use, and illustrating the patterned use of tactics during these sessions. Second, at the individual level, the focus is on examining individual students’ typical methods of using tactics, which helps to illustrate how tactic use contributes to the students’ achievement. The gStudy sessions were classified into three categories on the basis of tactic use: rare, moderate, and frequent. Findings indicate that frequent tactic use did not contribute to deep learning. Moderate tactic use was fairly effective for learning, but rare tactic use contributed to deep learning. The results did not show that the use of many study tactics improves learning; rather, they suggest that the distinguishing feature in strategic learning is not the tactic use itself but the way the tactic is performed.     

The comparative efficacy of 2D- versus 3D-based media design for influencing spatial visualization skills

This study explored the effects of 2D- versus 3D-based media representations on the influence of the spatial visualization ability of undergraduate science majors. A pre-test/post-test comparison-group experiment was conducted with 23 participants involved in the study. Participating students were randomly assigned either to the interactive 3D media representation group (n = 13) or the conventional 2D media representation group (n = 10); learning materials in both groups deliver the same information to students, but employ different media representations. All the activities were performed in a self-paced, web-based instructional system. The results of ANCOVA analysis showed statistically insignificant difference between groups in terms of students’ post-test scores on the spatial visualization ability test with the students’ pre-test scores as the covariate. However, a medium effect size was observed in favor of the 3D group in terms of practical significance. As a pilot study with a small sample size aiming to probe the research direction of this problem, the result of medium-sized effect magnitude is likely to implicate that the discrepancy of different representational design on students’ performance of spatial ability assessment is noteworthy. Future study of this nature appears to merit further replications and investigations.     

Using computer supported collaborative learning strategies for helping students acquire self-regulated problem-solving skills in mathematics

The main objective of this paper is to investigate the effectiveness of a proposed computer-based instructional method in Primary Education for self-regulated problem solving. The proposed instructional method is based on Sternberg’s model of problem solving within an authentic context. It consists of three main phases: observation, collaboration and semi-structured guidance. The ultimate learning objective is to augment the autonomous problem-solving skills of primary school children. In our study the Synergo tool was used, which is a synchronous computer supported collaborative learning tool, as well as the Moodle learning management system. The context which frames the method is authentic, very close to a students’ realistic learning situation. The findings of this study advocate that students can increase their problem-solving skills in a relatively short period of time. At the same time, they can improve their approach to the solution of a given mathematical problem, performing significant signs of autonomy.