The evaluation of online courses

Abstract Given the special characteristics of online courses, their quantitative/qualitative evaluation calls for the adoption of specific procedures to assess both the learning process and the participant performance. This paper seeks to shed light on the aspects and issues involved in the evaluation of online courses, focusing on the peculiarities that distinguish such evaluation from that of traditional distance education. Subsequently, a methodological approach will be proposed that was developed and tested during evaluation of online courses for in‐service teacher training and for training of staff in small and medium‐sized enterprises.     

Using group communication to monitor web-based group learning

Abstract  In a web group-learning environment, students must communicate with other group members on the Internet to accomplish group projects and share knowledge. Communication is likely to affect performance and so analysing the relationship between communicative relationships and group performance may help teachers to monitor groups effectively. Certain tasks are necessary to perform such an analysis — recording group communication, extracting communication relationships and determining the relationship between group communication and group performance. This study developed a method for determining relationships and rules for predicting performance to enable teachers to take act appropriately according to the predicted performance of the group. Four group performance indicators are considered — average grades within a group, project grade, frequency of resource-sharing and drop-out rate. Experimental results are presented, concerning the application of the methodology to a web class of 706 students, divided into 70 groups. The experimental results show that group communication patterns significantly affect group performance.     

Enhancing learning ecology on the Internet

Abstract Recent notions view learning as participation in a learning environment or community where learners work together and support each other as they use information resources and tools to pursue their learning goals and solve problems. A broader meaning is to extend the idea of the learning environment to the overall setting in which learning communities come into existence, evolve, fade away, regenerate or transform. The advent of the Internet has brought about a powerful medium for creating and supporting such a notion of the learning ecology. Through the image of biological ecologies with their diversity, complex dynamics, and opportunistic niches for growth, learning problems and solutions on the Internet are explored and ways to enhance the ecology are suggested.     

改善室内环境舒适度的一种新型控制方法

室内环境舒适度直接影响着在室人员的健康和工作效率,需要进行有效的控制以保证其舒适性。论文以某办公室为研究对象,提出一种基于同策蒙特卡罗自适应控制方法对建筑物内空调系统、加湿器、除湿器、照明系统和通风系统等设备优化控制,调节室内温湿度、照度和CO₂浓度提高室内舒适感。建立了有关影响室内环境舒适度的因素的状态变化的数学模型,并利用实验数据验证模型,同时与PID和模糊控制算法进行了仿真对比分析。结果表明：在同时控制影响室内环境的多个因素时,同策蒙特卡罗控制方法能够较好的跟踪实际情况,且该方法稳态误差较小,收敛速度较快。     

Social networks,communication styles,and learning performance in a CSCL community

The aim of this study is to empirically investigate the relationships between communication styles, social networks, and learning performance in a computer-supported collaborative learning (CSCL) community. Using social network analysis (SNA) and longitudinal survey data, we analyzed how 31 distributed learners developed collaborative learning social networks, when they had work together on the design of aerospace systems using online collaboration tools. The results showed that both individual and structural factors (i.e., communication styles and a pre-existing friendship network) significantly affected the way the learners developed collaborative learning social networks. More specifically, learners who possessed high willingness to communicate (WTC) or occupied initially peripheral network positions were more likely to explore new network linkages. We also found that the resultant social network properties significantly influenced learners’ performance to the extent that central actors in the emergent collaborative social network tended to get higher final grades. The study suggests that communication and social networks should be central elements in a distributed learning environment. We also propose that the addition of personality theory (operationalized here as communication styles) to structural analysis (SNA) contributes to an enhanced picture of how distributed learners build their social and intellectual capital in the context of CSCL.     

Students’ experiences with collaborative learning in asynchronous Computer-Supported Collaborative Learning environments

This paper describes an explorative study carried out to gain response from distance students on their experiences with collaborative learning in asynchronous computer supported collaborative learning (CSCL) environments. In addition, this study also attempts to have a good grip of crucial aspects concerning collaborative learning. The study was undertaken among distance learners from the Open University of the Netherlands who were working in groups of 4–11 persons. During and after the course students’ experiences with collaborative learning were measured and after the course also students’ satisfaction with collaborative learning was assessed. The finding revealed that distance learners appreciate the opportunities to work collaboratively. They show positive experiences and are quite satisfied with collaborative learning. This study also sought to explore individuals as well as course characteristics that influenced aspects of collaborative learning, and to search aspects of collaborative learning that influenced students’ satisfaction. The findings suggested that a group product influences group process regulation and group cohesion influences students’ satisfaction with collaborative learning.     

Impact of podcasting on student motivation in the online learning environment

Researchers investigated the impact of podcasting on student motivation in the online environment during fall 2008 and spring 2009. Data were collected from students enrolled in fourteen online courses at a research university in the United States. One hundred and ninety-one students completed a modified version of the Instructional Materials Motivation Survey (Keller, 2006); it has four subscales: attention, relevance, confidence, and satisfaction. Strong positive relationships between all subscales were detected. Results indicate students were moderately motivated by the use of podcasts in their online courses. Statistically significant differences in student motivation based on gender, class standing, and prior online learning experience were found. Benefits of using podcasts and recommendations for improvement of the multimedia files were offered by users.     

Social gaming is inSIDE: Impact of anonymity and group identity on performance in a team game-based learning environment

The present experiment aimed to determine how quiz performance in a team game-based learning environment can be predicted from the Social Identity model of Deindividuation Effects (SIDE). According to this model, anonymity influences social behavior by accentuating the salience of group identity and reducing interpersonal differences, leading to greater group identification and motivation to work for one's own group. As these effects could lead to higher cognitive performance, the goal of the present research was to extend predictions based on the SIDE model on performance in online game-based learning environments. After measuring their prior computing knowledge, 343 Master Degree students were placed in virtual teams on a trivial criterion to perform a series of online quizzes about computing and the Internet. An anonymous (or individuated) username was attributed to each team member to connect to the online learning environment, and information about comparison between teams was used to manipulate the degree of salience of group identity (high versus low). As predicted by the SIDE model, anonymity boosted performance when group identity was salient, but only for students with low prior knowledge. Unexpectedly, it was also found that anonymity boosted the performance of students with high prior knowledge when group identity was not salient. A similar pattern was found for perceived mastery of computing and the Internet. Theoretical and practical implications of the SIDE model are discussed, and specifically its application to social gaming to optimize online learning.     

Participation in virtual academic communities of practice under the influence of technology acceptance and community factors. A learning analytics application

Participation in virtual communities of practice (vCoP) can be influenced at the same time by technology acceptance and by community factors. To overcome methodological issues connected with the analysis of these influences, learning analytics were applied. Based on a recent vCoP model, the collaborative dialogue comprising 4040 interventions in 1981 messages created by a vCoP located at a US American online university was automatically analyzed. The text-based asynchronous online discussions were scored using a cohesion-based participation and collaboration analysis. Additionally, a sample of N = 133 vCoP participants responded a technology acceptance survey. Thus, a combined research model including the vCoP model and an established technology acceptance model was verified. The results confirmed the vCoP model entirely, and the acceptance model only partially. As consequence for educational research, the CoP model was confirmed and extended to vCoP settings, while the acceptance model appears to need reconsideration. For academic practice, the study initiates the development of assessment tools fostering knowledge sharing through dialogue in vCoP. Also, it suggests how virtual classrooms can be extended to open spaces where value creation takes place through social learning. Learning analytics proved thus successful, provides information that impacts both theory and practice of technology-enhanced learning.     

Co-reflection in online learning: Collaborative critical thinking as narrative

This article presents findings from a comparative case study of the learning experiences of two graduate students in an online action research course. The key roles played by reflection and co-reflection, an emerging concept, are identified through the use of narrative analysis. Co-reflection is a collaborative critical thinking process mediated by language, broadly construed to include all meaningful signs. Two types of co-reflection are proposed: tacit and active. Regardless of type, the evidence shows that co-reflection involves cognitive and affective interactions in synergy with relationship building. To the study of group cognition, this study contributes evidence of the potential of co-reflection as a core process. The simple, flexible software tools used in the course (wiki-style collaborative software and simple email and chat programs) effectively supported inquiry learning and co-reflection by allowing learners to freely and easily create their own web pages and to adapt the tools for their different communication and learning styles.     

How media choice affects learner interactions in distance learning classes

In this research we explore aspects of learning, social interaction and community across online learning, also known as distance learning, in higher education. We measure the impact of online social networking (OSN) software versus traditional learning management system (LMS) software. Guided by a theoretical model for how individuals learn and interact within online communities, we measure student perceptions of learning, social interaction and course community before and after our interventions. Survey instruments measure perceived learning, social interaction and community, which we further explore using social network analysis (SNA). Survey results identified that students experienced higher levels of perceived social interaction and course community and, overall, had higher levels of satisfaction with OSN software than those using LMS software. Along this line, SNA results corroborated that OSN software yielded a higher number of interactions, providing a more engaging learning experience.     

Examining learning in relation to the contexts of use of ICT

Abstract Although ICT resources are commonly expected to produce uniform benefits, they are necessarily employed within pre-existing contexts of educational and social activity, and the outcome in terms of both pattern of use and learning depends on how they fit in with these. As a result, the same technology or software may have unexpectedly diverse effects, according to specific setting. If the object is to exercise control over outcome, then the conditions of use need to be planned for within the design and implementation of the technology. In order to do this, it is crucial that research gathers data on how outcomes are affected by the interplay between technology and context. This raises questions about the methods that would be appropriate for the conduct and dissemination of such research. These points are discussed in relation to three studies, one each at primary, secondary and university levels of education.     

The expression of social presence through the use of figurative language in a web-based learning environment

The present paper’s aim is to investigate how the participants of an online learning environment employed written language in a creative way through the spontaneous use of figurative language. The content analysis showed that figurative language was a means to express the social dimension either to refer to the self, feelings and emotions, or to conceptualize the components of the virtual learning setting. The research context was a 10-week course, delivered at a distance via a computer conferencing system, addressed to 57 student teachers. The analysis was carried out in the social and meta-cognitive reflection areas, those areas which are mainly related to the expression of the social dimension The study had three different purposes: to investigate the distribution of figurative language during the course length; to explore the relation between the participants’ educational background and their use of figurative language, and to examine the relation between figurative language and the structure of the communication threads. The results indicate that participants tended to use figurative language more when meaningful or critical events happened. The higher the emotional involvement was, the more metaphorical language was adopted. Further results suggest that the adoption of figurative language seems to be related more to individual attitude, than to other factors such as educational background. Finally, figurative language occurrences were not concentrated in specific kinds of postings or threads and did not encourage further use of figurative language.     

Discourse cues to deception in the case of multiple receivers

Behavioral cues to deception are instrumental in detecting deception. As one of the primary sources of deception behavior, text has been analyzed at the level of sub-sentence or message but not the discourse of interaction. Additionally, empirical studies on cues to deception in the case of multiple receivers remain nonexistent. To fill these voids, we propose a discourse framework and six hypotheses about deception behaviors in a multi-receiver environment. The deception behaviors are operationalized by discourse features based on an analysis of real-world data. The results of statistical analysis validate the efficacy of discourse features in discriminating deceivers from truth-tellers.     

Social presence in relation to students' satisfaction and learning in the online environment: A meta-analysis

Social presence, the ability to perceive others in an online environment, has been shown to impact student motivation and participation, actual and perceived learning, course and instructor satisfaction, and retention in online courses; yet very few researchers have attempted to look across contexts, disciplinary areas, or measures of social presence. This meta-analysis allowed us to look across these variables of the primary studies and identify the pattern of student outcomes (e.g., perceived learning and satisfaction) in relation to social presence through scrutiny of differences between the studies. The results showed a moderately large positive average correlation between social presence and satisfaction (r = 0.56, k = 26) and social presence and perceived learning (r = 0.51, k = 26). Large variation among correlations (86.7% for satisfaction and 92.8% for perceived learning, respectively) also indicated systematic differences among these correlations due to online course settings. We found that (a) the strength of the relationship between social presence and satisfaction was moderated by the course length, discipline area, and scale used to measure social presence; and (b) the relationship between social presence and perceived learning was moderated by the course length, discipline area, and target audience of the course. Implications and future research are discussed.     

Applying social learning analytics to message boards in online distance learning: A case study

Social learning analytics introduces tools and methods that help improving the learning process by providing useful information about the actors and their activity in the learning system. This study examines the relation between SNA parameters and student outcomes, between network parameters and global course performance, and it shows how visualizations of social learning analytics can help observing the visible and invisible interactions occurring in online distance education.The findings from our empirical study show that future research should further investigate whether there are conditions under which social network parameters are reliable predictors of academic performance, but also advises against relying exclusively in social network parameters for predictive purposes. The findings also show that data visualization is a useful tool for social learning analytics, and how it may provide additional information about actors and their behaviors for decision making in online distance learning.     

A step further in Peer Instruction: Using the Stepladder technique to improve learning

Peer Instruction (PI) is an instructional strategy for engaging students during class through a structured questioning process that improves the learning of the concepts of fundamental sciences. Although all students are supposedly engaged in discussions with their peers during Peer Instruction, the learning gains generally remain at a medium level, suggesting a lack of participation of certain students who do not benefit from social interactions. The present study examined whether the Stepladder technique might optimize the Peer Instruction method and increase learning gains. With this technique, students enter a group sequentially, forcing every group member to participate in discussions. Eighty-four chemistry students were asked to answer easy and difficult multiple-choice questions before and after being randomly assigned to one of three instructional conditions during a chromatography lesson (Classic PI vs. Stepladder PI vs. Individual Instruction without any discussion with peers). As predicted, results showed that learning gains were greatest in the Stepladder PI group, and that this effect was mainly observed for difficult questions. Results also revealed higher perceived satisfaction when students had to discuss the questions with their peers than when they were not given this possibility. By extending the Stepladder technique to higher education, these findings offer a step forward in the Peer Instruction literature, showing how it can enhance learning gains.