Facilitating peer knowledge modeling: Effects of a knowledge awareness tool on collaborative learning outcomes and processes

We report an empirical study where we investigated the effects, on the collaborative outcomes and processes, of a cognition-related awareness tool providing learners with cues about their peer’s level of prior knowledge. Sixty-four university students participated in a remote computer-mediated dyadic learning scenario. Co-learners were provided (or not) with a visual representation of their peer’s level of prior knowledge through what we refer to as a knowledge awareness tool (KAT). The results show that, providing co-learners with objective cues about the level of their peer’s prior knowledge positively impacts learning outcomes. In addition, this effect seems to be mediated by the fact that co-learners provided with these objective cues become more accurate in estimating their partner’s knowledge - accuracy that predicts higher outcomes. Analyses on the process level of the verbal interactions indicate that the KAT seems to sensitize co-learners to the fragile nature of their partner’s as well as their own prior knowledge. The beneficial effect of the KAT seems to mainly rely on this induction of epistemic uncertainty that implicitly triggers compensation socio-cognitive strategies; strategies that appear to be beneficial to the learning process.     

Using online shared workspaces to support group collaborative learning

The ability to work collaboratively is highly valued in today’s workplace. However, collaboration does not often naturally happen in a group. Certain strategies must be applied to coordinate individual efforts and monitor the learning process so that effective collaboration can take place. 34 groups from 4 PGDE (Post Graduate Diploma in Education) classes at NIE (National Institute of Education) in Singapore participated in this study. Each group of four members used an online shared workspace to collaborate. Results showed that about half groups actively used the workspaces to share resources, negotiate ideas, and coordinate their collaboration. On the other hand, using the workspaces helped the teacher to easily track and monitor the collaborative learning process, as the workspaces documented what group members did and how they gradually completed the assignment. The students were also required to write weekly progress reports. Results showed that writing progress reports helped group members to reflect on what they had done and also provided additional information for the teacher to confirm their individual contributions. Issues involved in coordinating and monitoring the collaborative learning process are discussed.     

Measurement and assessment in computer-supported collaborative learning

The overall goal of CSCL research is to design software tools and collaborative environments that facilitate social knowledge construction via a valuable assortment of methodologies, theoretical and operational definitions, and multiple structures [Hadwin, A. F., Gress, C. L. Z., & Page, J. (2006). Toward standards for reporting research: a review of the literature on computer-supported collaborative learning. In Paper presented at the 6th IEEE International Conference on Advanced Learning Technologies, Kerkrade, Netherlands; Lehtinen, E. (2003). Computer-supported collaborative learning: an approach to powerful learning environments. In E. De Corte, L. Verschaffel, N. Entwistle & J. Van Merriëboer (Eds.), Unravelling basic components and dimensions of powerful learning environments (pp. 35–53). Amsterdam, Netherlands: Elsevier]. Various CSCL tools attempt to support constructs associated with effective collaboration, such as awareness tools to support positive social interaction [Carroll, J. M., Neale, D. C., Isenhour, P. L., Rosson, M. B., & McCrickard, D. S. (2003). Notification and awareness: Synchronizing task-oriented collaborative activity. International Journal of Human–Computer Studies 58, 605] and negotiation tools to support group social skills and discussions [Beers, P. J., Boshuizen, H. P. A. E., Kirschner, P. A., & Gijselaers, W. H. (2005). Computer support for knowledge construction in collaborative learning environments. Computers in Human Behavior 21, 623–643], yet few studies developed or used pre-existing measures to evaluate these tools in relation to the above constructs. This paper describes a review of the measures used in CSCL to answer three fundamental questions: (a) What measures are utilized in CSCL research? (b) Do measures examine the effectiveness of attempts to facilitate, support, and sustain CSCL? And (c) When are the measures administered? Our review has six key findings: there is a plethora of self-report yet a paucity of baseline information above collaboration and collaborative activities, findings in the field are dominated by ‘after collaboration’ measurement, there is little replication and an over reliance on text-based measures, and an insufficient collection of tools and measures for examining processes involved in CSCL.     

Measuring perceived sociability of computer-supported collaborative learning environments

Most asynchronous computer-supported collaborative learning (CSCL) environments can be characterized as functional environments because they focus on functional, task-specific support, often disregarding explicit support for the social (emotional) aspects of learning in groups which are acknowledged by many educational researchers to be essential for effective collaborative learning. In contrast, sociable CSCL environments emphasize the social (emotional) aspects of group learning. We define sociability as the extent to which a CSCL environment is perceived to be able to facilitate the emergence of a sound social space with attributes as trust and belonging, a strong sense of community, and good working relationships. Specific environmental characteristics, which we have designated social affordances, determine sociability.     

The effect of functional roles on perceived group efficiency during computer-supported collaborative learning: a matter of triangulation

In this article, the effect of functional roles on group performance and collaboration during computer-supported collaborative learning (CSCL) is investigated. Especially the need for triangulating multiple methods is emphasised: Likert-scale evaluation questions, quantitative content analysis of e-mail communication and qualitative analysis of open-ended questions were used. A comparison of 41 questionnaire observations, distributed over 13 groups in two research conditions – groups with prescribed functional roles (n = 7, N = 18) and nonrole groups (n = 6, N = 23) – revealed no main effect for performance (grade). Principal axis factoring of the Likert-scales revealed a latent variable that was interpreted as perceived group efficiency (PGE). Multilevel modelling (MLM) yielded a positive marginal effect of PGE. Most groups in the role condition report a higher degree of PGE than nonrole groups. Content analysis of e-mail communication of all groups in both conditions (role n = 7, N = 25; nonrole n = 6, N = 26) revealed that students in role groups contribute more ‘coordination’ focussed statements. Finally, results from cross case matrices of student responses to open-ended questions support the observed marginal effect that most role groups report a higher degree of PGE than nonrole groups.     

Tacit guidance for collaborative multimedia learning

Collaborative multimedia learning is a scenario placing various demands on the learners that go beyond understanding complex issues and coordinating a learning discourse. On the one hand, individuals have to mentally interrelate multiple external representations in order to understand the learning material and the underlying concepts; on the other hand, during collaboration, learners have to use the differently coded information in order to exchange conceptual knowledge. In this paper, the development and experimental evaluation of a group awareness tool (collaborative integration tool) is presented that is intended to simultaneously support both individual and collaborative learning processes during dyadic collaborative multimedia learning. The tool was experimentally compared with an integration task that already proved to foster meaningful individual learning processes. The results suggest that providing group awareness can lead to better individual learning gains by reducing demanding processes and by tacitly guiding learner interactions.     

Gender-related differences in computer-mediated communication and computer-supported collaborative learning

Abstract   A question associated with the introduction of computer-supported collaborative learning (CSCL) is whether all participants profit equally from working in CSCL environments. This article reports on a review study into gender-related differences in participation in CSCL. As many of the processes in CSCL are similar to those in computer-mediated communication (CMC), studies into CMC are also included in the review. Male dominance is found to play a role in many CMC settings. A learning culture with an explicit focus on participation by all students seems to be related to a more gender-balanced participation in CMC, however. A tendency for boys to be more active participants than girls is also present in CSCL environments, but it is less pronounced than in CMC. This may be explained by the fact that participation is explicitly promoted in most CSCL environments. Gender differences in the character of students' contributions are found in both CMC and CSCL. It is concluded that in order to avoid gender-stereotyped participation and communication patterns, it is necessary to explicitly address inclusiveness as an aspect of a collaborative classroom culture. A plea is made for further research into differential participation by students in CSCL, and the effects thereof on cognitive and affective learning outcomes. Research should also focus on the question how classroom cultures can be promoted that support active participation of all students aimed at collaborative knowledge construction.     

Visualization of agreement and discussion processes during computer-supported collaborative learning

This study examined the effects of the shared space (SS) on students’ behaviors in a computer-supported collaborative learning (CSCL) environment. The SS visualizes discussion and agreement during online discussions. It was hypothesized the SS would increase the media richness of the CSCL-environment, would stimulate critical and exploratory group-norms, would lead to more positive perceptions of online collaboration, and would have an impact on students’ collaborative activities. In total, 59 students working in 20 groups had access to the SS visualization, while 58 students working in 20 groups did not. The results show that students with access to the SS visualization: (a) perceived higher media richness; (b) had a more exploratory group-norm perception; (b) perceived more positive group behavior; (c) perceived their group’s task strategies to be more effective; (d) engaged in different collaborative activities and (e) performed better on one part of the group task. These results demonstrate the potential benefits of visualizing agreement and discussion during CSCL.     

Undergraduates’ metacognitive knowledge about the psychological effects of different kinds of computer-supported instructional tools

Literature about metacognition suggests that learners develop personal beliefs about the educational technologies that they are asked to employ and that such beliefs can influence learning outcomes. In this perspective, opinions about the psychological effects of computer-supported instructional tools were analysed by means of a questionnaire which included items about the motivational and emotional aspects of learning, the behaviour to have during the learning process, the mental abilities and the style of thinking required, and the cognitive benefits. Items were presented five times: each time they made reference to a different kind of tool (online courses, hypertexts, Web forums, multimedia presentations, and virtual simulations). The questionnaire was filled out by 99 undergraduates attending engineering courses. Results showed that students ranked the psychological effects of the computer-supported tools in a relative different order according to the kind of tool and attributed distinctive effects to each tool. Gender and expertise played a minor role in modulating undergraduates’ beliefs. Implications for instruction were discussed.     

The effect of computer-assisted cooperative learning methods and group size on the EFL learners’ achievement in communication skills

This study explored the effect of cooperative learning small group size and two different instructional modes (positive interdependence vs. individual accountability) on English as a Foreign Language (EFL) undergraduate learners’ communication skills (speaking and writing) achievement in computer-based environments. The study also examined the effects of disclosing/blinding the participants’ identities while interacting around computers on their post-test. The findings of the study revealed that the computer-based environment enabled the participants to blind their identities and reduce their anxiety from face-to-face debate, and so was very helpful in developing their communication skills. The use of the individual accountability mode was quite useful compared with the positive interdependence mode as it enabled all group members to perform their roles significantly. The 5-student group also significantly outperformed other groups of 2-7 members on the post-test communication skills. In conclusion, the findings of this study bring us a step closer to understanding the technique of cooperative language learning and group size.     

Exploring regulatory processes during a computer-supported collaborative learning task using process mining

The purpose of this study was to explore sequences of social regulatory processes during a computer-supported collaborative learning task and their relationship to group performance. Analogous to self-regulation during individual learning, we conceptualized social regulation both as individual and as collaborative activities of analyzing, planning, monitoring and evaluating cognitive and motivational aspects during collaborative learning. We analyzed the data of 42 participants working together in dyads. They had 90 min to develop a common handout on a statistical topic while communicating only via chat and common editor. The log files of chat and editor were coded regarding activities of social regulation. Results show that participants in dyads with higher group performance (N = 20) did not differ from participants with lower group performance (N = 22) in the frequencies of regulatory activities. In an exploratory way, we used process mining to identify process patterns for high versus low group performance dyads. The resulting models show clear parallels between high and low achieving dyads in a double loop of working on the task, monitoring, and coordinating. Moreover, there are no major differences in the process of high versus low achieving dyads. Both results are discussed with regard to theoretical and empirical issues. Furthermore, the method of process mining is discussed.     

The impact of goal focus, task type and group size on synchronous net-based collaborative learning discourses

Net-based collaborative learning discourses often suffer from deficiencies such as lack of coherence and coordination. It is suggested that the provision of two functionalities, referencing and typing, which learners may optionally use to ground their contributions during a chat-based discourse, can improve collaborative learning. In particular, we examined if goal focus, type of task and group size affect learning outcomes and the use of these functionalities. A chat-based system, called a learning protocol, implements these functionalities and serves as a net-based collaborative learning environment. Results suggest that a learning protocol is more beneficial for knowledge-acquisition tasks than for problem-solving tasks, and that the use of supporting functionalities increases when goal focus is on the group rather than on the individual. Also, there is a tendency that learning outcomes improve as group size increases. We propose that learning protocols provide potentially valuable design features that can promote net-based collaborative learning.     

Advancing educational research on collaboration through the use of gStudy computer-supported collaborative learning (CSCL) tools: Introduction to special issue

This is an introduction to a special issue on computer-supported collaborative learning.     

Visualization of participation: Does it contribute to successful computer-supported collaborative learning?

This study investigated the effects of visualization of participation during computer-supported collaborative learning (CSCL). It is hypothesized that visualization of participation could contribute to successful CSCL. A CSCL-environment was augmented with the Participation Tool (PT). The PT visualizes how much each group member contributes to his or her group’s online communication. Using a posttest-only design with a treatment (N = 52) and a control group (N = 17), it was examined whether students with access to the PT participated more and more equally during collaboration, reported higher awareness of group processes and activities, collaborated differently, and performed better than students without access to the PT. The results show that students used the PT quite intensively. Furthermore, compared to control group students, treatment group students participated more and engaged more in coordination and regulation of social activities during collaboration by sending more statements that addressed the planning of social activities. However, equality of participation, awareness of group processes and quality of the group products was not higher in the treatment condition. Still, the results of this study demonstrate that visualization of participation can contribute to successful CSCL.     

Differences in learning processes between successful and less successful students in computer-supported collaborative learning in the field of human nutrition and health

This study aimed to investigate the differences in learning processes between successful and less successful pairs of students in computer-supported collaborative learning (CSCL) in the field of human nutrition and health. As part of their regular MSc (and optional BSc) course “Exposure assessment in nutrition and health research” at Wageningen University, 44 students were asked (as an individual pretest) to design and analyze a study which evaluates a certain dietary assessment method. Subsequently, they were asked to discuss their evaluation studies in randomized pairs using a CSCL platform. As an individual posttest, students had to re-design and re-analyze the same evaluation study. The quality of students’ knowledge construction in both tests and characteristics of their learning processes in the CSCL environment were assessed through two coding schemes. Based on their learning outcomes (quality of knowledge construction), pairs of students were divided into two subgroups: successful and less successful students. Next, the learning processes of these subgroups were compared. This study revealed that the learning processes of successful and less successful students in the CSCL environment differed in terms of relevance, width and depth of discussion and justification and reasoning. Based on these findings, recommendations for further research and educational practice are formulated.     

The role of metacognitive listening strategies awareness and podcast-use readiness in using podcasting for learning English as a foreign language

The aim of this study was to investigate the role of English as Foreign Language (EFL) learners’ metacognitive listening strategies awareness and podcast-use readiness in using podcasting technology for learning English as a foreign language. One hundred and forty-one EFL students completed Metacognitive Awareness Listening Questionnaire (MALQ) that assessed their awareness and perceived use of listening strategies in five components including planning-evaluation, directed attention, person knowledge, mental translation, and problem solving. They also completed a questionnaire that assessed their readiness to use podcasting in terms of familiarity, attitude, and experience. Information on participants’ frequency of podcast use for learning English, frequency of the internet use, and digital device ownership was also obtained. The result of the analysis revealed that podcasting use was significantly related to metacognitive listening strategies awareness in general and its entire components except mental translation strategies while the strongest correlation was found with problem solving strategies (r = .49, p < 0.01). Podcasting use was also found to be significantly related to perceived podcast-use readiness and internet use hours. Further, multiple regressions showed that perceived podcast-use readiness, problem solving, and person knowledge -in order of power prediction- were good predictors of podcasting use for learning English as a foreign language.