Improving literacy and metacognition with electronic portfolios: Teaching and learning with ePEARL

Can an electronic portfolio that is both a multimedia container for student work and a tool to support key learning processes have a positive impact on the literacy practices and self-regulated learning skills of students? This article presents the findings of a yearlong study conducted in three Canadian provinces during the 2007–2008 school year initially involving 32 teachers and 388 students. Due to varying levels of implementation our final data set included 14 teachers and 296 students. Using a non-equivalent pre-test/post-test design, we found that grade 4–6 students who were in classrooms where the teacher provided regular and appropriate use of the electronic portfolio tool ePEARL (i.e., medium–high implementation condition, n = 7 classrooms and 121 students), compared to control students (n = 7 classrooms and 175 students) who did not use ePEARL, showed significant improvements (p < .05) in their writing skills on a standardized literacy measure (i.e., the constructed response subtest of the Canadian Achievement Test-4th ed.) and certain metacognitive skills measured via student self-report. The results of this study indicate that teaching with ePEARL has positive impacts on students’ literacy and self-regulated learning skills when the tool is used regularly and integrated into classroom instruction.     

The effect of functional roles on perceived group efficiency during computer-supported collaborative learning: a matter of triangulation

In this article, the effect of functional roles on group performance and collaboration during computer-supported collaborative learning (CSCL) is investigated. Especially the need for triangulating multiple methods is emphasised: Likert-scale evaluation questions, quantitative content analysis of e-mail communication and qualitative analysis of open-ended questions were used. A comparison of 41 questionnaire observations, distributed over 13 groups in two research conditions – groups with prescribed functional roles (n = 7, N = 18) and nonrole groups (n = 6, N = 23) – revealed no main effect for performance (grade). Principal axis factoring of the Likert-scales revealed a latent variable that was interpreted as perceived group efficiency (PGE). Multilevel modelling (MLM) yielded a positive marginal effect of PGE. Most groups in the role condition report a higher degree of PGE than nonrole groups. Content analysis of e-mail communication of all groups in both conditions (role n = 7, N = 25; nonrole n = 6, N = 26) revealed that students in role groups contribute more ‘coordination’ focussed statements. Finally, results from cross case matrices of student responses to open-ended questions support the observed marginal effect that most role groups report a higher degree of PGE than nonrole groups.     

The role of metacognitive listening strategies awareness and podcast-use readiness in using podcasting for learning English as a foreign language

The aim of this study was to investigate the role of English as Foreign Language (EFL) learners’ metacognitive listening strategies awareness and podcast-use readiness in using podcasting technology for learning English as a foreign language. One hundred and forty-one EFL students completed Metacognitive Awareness Listening Questionnaire (MALQ) that assessed their awareness and perceived use of listening strategies in five components including planning-evaluation, directed attention, person knowledge, mental translation, and problem solving. They also completed a questionnaire that assessed their readiness to use podcasting in terms of familiarity, attitude, and experience. Information on participants’ frequency of podcast use for learning English, frequency of the internet use, and digital device ownership was also obtained. The result of the analysis revealed that podcasting use was significantly related to metacognitive listening strategies awareness in general and its entire components except mental translation strategies while the strongest correlation was found with problem solving strategies (r = .49, p < 0.01). Podcasting use was also found to be significantly related to perceived podcast-use readiness and internet use hours. Further, multiple regressions showed that perceived podcast-use readiness, problem solving, and person knowledge -in order of power prediction- were good predictors of podcasting use for learning English as a foreign language.     

Facebook and political engagement: A study of online political group membership and offline political engagement

In what ways do online groups help to foster political engagement among citizens? We employ a multi-method design incorporating content analysis of online political group pages and original survey research of university undergraduates (n = 455) to assess the relationship between online political group membership and political engagement—measured through political knowledge and political participation surrounding the 2008 election. We find that participation in online political groups is strongly correlated with offline political participation, as a potential function of engaging members online. However, we fail to confirm that there is a corresponding positive relationship between participation in online political groups and political knowledge, likely due to low quality online group discussion.     

Motivation of computer based learning across adulthood

This research investigates learning motivation of young and old adults. In detail, we explore motives of young and old adults to participate in two ICT-course settings: e-learning and face-to-face courses. In a first study young (n = 53, M = 26.0 years) and old (n = 55, M = 69.8 years) participants of e-learning courses completed an online questionnaire on learning motivation and personality. In a second study young (n = 46, M = 26.7 years) and old (n = 57, M = 69.5 years) participants of face-to-face ICT courses completed the same learning motivation questionnaire and questions about personality, subjective age and life satisfaction. Exploratory factor analysis revealed four factors of learning motivation: belonging, instrumentality, personal growth, and competition. As expected, older adults expressed stronger motives of belonging and personal growth, and thus expressed a stronger interest in self-determined and intrinsic learning. Young adults, in contrast, strongly endorsed competitive-related motives of learning. Instrumentality was influenced by the interaction of age and subjective age; older participants showed higher instrumentality when the difference between chronological age and subjective age is big. Findings of this study shed new light on assumptions of socioemotional selectivity theory.     

Intensive use of ICT in school: Developing differences in students’ ICT expertise

The purpose of the study was to examine the development of students’ high-level computer skills and competence (student expertise) in information and communication technology (ICT), and to examine the characteristics of such expertise. Eighteen lower secondary school students, selected to represent both genders and all school achievement levels, were given laptops for three years to be used both at school and at home. The data of the longitudinal study consisted of a test on ICT skills; self-evaluation questionnaires on ICT competence, thoughts about their own expertise, ICT-related activities and task, interest in ICT, and classroom observations. The results of the study indicated that the intensive use of ICT and the process-oriented learning environment supported the development of student expertise. In the analysis, three groups were identified, which oriented themselves somewhat differently in relation to ICT: student experts (n = 6), advanced users (n = 8) and non-interested users (n = 4). The experts differed from the other groups in respect of especially focusing on advancing their ICT skills; they had undertaken ICT-related tasks outside the school, they had metacognitive consciousness about their competence, and they had future plans concerning ICT in their further education and profession.     

Dynamic scaffolding of socially regulated learning in a computer-based learning environment

The aim of this study is to test the effects of dynamically scaffolding social regulation of middle school students working in a computer-based learning environment. Dyads in the scaffolding condition (N = 56) are supported with computer-generated scaffolds and students in the control condition (N = 54) do not receive scaffolds. The scaffolds are dynamically adjusted to dyads’ progress with an attention management system. The scaffolds support two aspects of socially regulated learning namely the metacognitive and cognitive activities. We analyzed the effects of dynamic scaffolding on dyads’ performance, their perception of the learning environment and students' knowledge acquisition. We found that scaffolding had a positive effect on the dyads’ learning performance, but did not affect students’ domain knowledge. The repeated measurements of perception of the learning environment showed that dyads in the experimental condition were more positive about their teachers and their collaborators than students in the control condition. With respect to their perception of the software and the 3D embodied agent delivering the scaffolds, we found a stronger decrease of appreciation over time in the scaffolding condition compared to the control condition.     

Do students need teacher’s initiation in online collaborative learning?

As more and more people use computers to complete their work and solve problems in the workplace, computing education is emphasized for students of all levels and disciplines in Taiwan. However, the computing education in Taiwan can hardly be recognized as effective and satisfactory. Many inappropriate examples that lack context are used in teaching and textbooks that may result in employees with low competence and insufficient ability for collaborative working. Students who grow up in this learning context usually lack the ability to seek information and solve problems by themselves. In this regard, the author redesigned a course and adopted online collaborative learning with initiation to establish the essential knowledge for students’ collaboration in the initial stage of a course. This study conducted an experiment that included 169 undergraduates from three class sections – the first two from an academic university (Case 1, n = 68; Case 2, n = 68) and the last one from a university of science and technology (Case 3, n = 33) – taught by the same teacher under the same course name and the same course website. The results show that students who received online collaborative learning with initiation had higher grades than those without. The author further discusses the implications for teachers, schools, and scholars who plan to provide online courses for their students, particularly computing courses.     

Web-based Personalised System of Instruction: An effective approach for diverse cohorts with virtual learning environments?

The Personalised System of Instruction is a form of mastery learning which, though it has been proven to be educationally effective, has never seriously challenged the dominant lecture-tutorial teaching method in higher education and has largely fallen into disuse. An information and communications technology assisted version of the Personalised System of Instruction using a virtual learning environment is promoted here based on the authors’ longitudinal design research into this pedagogy. The particular elements of the virtual learning environment which are promoted are short video clips, online formative tests and an assessment management system. The authors present their experiences of developing and deploying this pedagogy for the teaching of introductory discrete mathematics to large classes of Computer Science students at two UK higher education institutions both with whole cohorts and ‘at risk’ groups of students. In particular, this method is promoted as particularly helpful to students who do not adopt a deep approach to learning as many students fail to do. Moreover ‘at risk’ students using this method (n = 71) demonstrated an average Glass effect size of 0.83 compared with other ‘at risk’ students who did not (n = 35). Based on these experiences, this pedagogy is promoted as an effective approach to teaching in higher education, especially the teaching of cognitive skills to diverse cohorts of students on foundation level modules.     

Awareness of group performance in a CSCL-environment: Effects of peer feedback and reflection

This study investigated the effects of a peer feedback tool and a reflection tool on social and cognitive performance during computer supported collaborative learning (CSCL). A CSCL-environment was augmented with a peer feedback tool (Radar) and a reflection tool (Reflector) in order to make group members aware of both their individual and their group behavior. Radar visualizes how group members perceive their own social and cognitive performance and that of their peers during collaboration along five dimensions. Reflector stimulates group members to reflect upon their own performance and the performance of the group. A 2 × 2 factorial between-subjects design was used to examine whether Radar and Reflector would lead to better team development, more group satisfaction, lower levels of group conflict, more positive attitudes toward problem-based collaboration, and a better group product. Results show that groups with Radar perceived their team as being better developed, experienced lower conflict levels, and had a more positive attitude towards collaborative problem solving than groups without Radar. The quality of group products, however, did not differ. The results demonstrate that peer feedback on the social performance of individual group members can enhance the performance and attitudes of a CSCL-group.     

Cognitive consequences of making computer-based learning activities more game-like

Some students (base group) played the Circuit Game, a 10-level computer-based learning activity intended to help students learn how electrical circuits work. Other students (competition group) played the same game but with competition features added - including a score bar showing performance on each level, the opportunity to earn one ticket per level if a performance criterion is met, and the opportunity to win a prize based on the number of tickets earned. On a retention test given after the game, the competition group remembered significantly more than the base group (d = 0.47). On an embedded transfer test constituting the final level of the game, the groups did not differ significantly. However, on the transfer test there was a significant gender by group interaction in which men performed worse in the competition group than the base group (d = −0.54) and women performed better in the competition group than the base group (d = 0.24). Overall, adding game-like features to a computer-based learning activity caused students to pay attention to game details but did not motivate students - particularly men - to learn more deeply.     

Short- and long-term effects of students’ self-directed metacognitive prompts on navigation behavior and learning performance

This study seeks to promote learning in computer-based learning environments utilizing students’ self-directed metacognitive prompts. Such prompts are based on the idea of instructing students to design their own metacognitive scaffolds and learn with them afterward. In a pre-post experimental design, students in the experimental group (n = 35) were instructed to configure their own metacognitive prompts before learning whereas students in the control group (n = 35) learned without prompts. Log file analysis of navigation behavior indicates that students who learned with their individually designed, self-directed prompts visited relevant webpages significantly more often and spent a longer time on them compared with students in the control group. Moreover, participants in the experimental group attained better transfer performance immediately after learning. The long-term effect in transfer performance was even greater in a follow-up learning session conducted after three weeks without any instructional support in either group. These results are consistent with theories of metacognition and self-regulated learning and indicate that self-directed prompts can lead to sustainable effects.     

Performance measures in courses using computer-aided personalized system of instruction

Archived data from four courses taught with computer-aided personalized system of instruction (CAPSI) – an online, self-paced, instructional program – were used to explore the relationship between objectively rescored final exam grades, peer reviewing, and progress rate – i.e., the rate at which students completed unit tests. There was a strong positive correlation (r = .68, p < .01) between rate of progress and the amount of peer reviewing students did. This was predictable because peer reviewers had to be further along in the course than the students whose unit tests they reviewed. Students who completed all the units tended to obtain higher final exam scores than those who did not. For students who completed all the units there was little difference between the final exam performance of those who had a high progress rate and those who had a low progress rate. Considering all students together there was a moderate correlation between progress rate and final exam performance (r = .36, p < .01). In addition, there was a moderate positive correlation (r = .33, p < .01) between the amount of peer reviewing students did and their performance on the final exam. This correlation was substantially reduced (r = .13, p < .20) when rate of progress was partialed out. Thus, overall, students who progressed more rapidly through the course did more peer reviewing and learned more as measured by final exam performance. Interestingly, there were students who showed good learning without much participation in course related behaviors such as completing unit tests and peer reviewing. It is concluded that the CAPSI instructional program provides a good learning environment for students who utilize its components but it also accommodates other learning styles. In addition, there may be a distinction between students who complete all assigned units and those who do not regardless of their tendencies to procrastinate.     

Self-regulated learning through writing on computers: Consequences for reading comprehension

The overall aim for the present study was to analyze the consequences for reading ability among the children of a computer supported self-regulated learning environment in grade two. By means of a quasi-experimental design in a natural setting, an experimental group (n = 39) was compared to a control group from a national sample (n = 3409) on reading comprehension. The statistical analyses showed that the experimental group achieved better on reading comprehension both as a group (p < .001) as well as girls (p < .001) and boys (p < .05) separately. The proportion of high achievers was higher, and the proportion of low achievers was lower in the experimental group. In order to explain the level of reading comprehension in the experimental group Structural Equation Modelling (SEM) was used. The main explanatory factor for reading comprehension was writing with β = .44. As a tentative conclusion it was suggested that the extended writing in combination with the self-regulated learning environment can promote reading comprehension in grade two, whereas home literacy had no impact on reading comprehension in this context.     

Adolescents’ use of Instant Messaging as a means of emotional relief

Instant Messaging (IM) plays a major role in online communication, whether through dedicated software or through chat integrated in a social network’s platform. IM-based online conversation enables private, synchronous, interpersonal communication while being invisible and possibly anonymous; facilitates self-disclosure and intimacy; and possesses advantageous features of expressive writing and social support. For adolescents, the use of IM is a legitimate, available, and free alternative vehicle for communicating with peers to ventilate negative emotions and to receive social support and advice. The present study examined effects of IMing friends on the emotional state of distressed adolescents through both pre-post (n = 100) analyses and comparison with an un-distressed group (n = 50). Dependent measures included self-report questionnaires, textual analysis, and expert judges’ evaluations of the conversations. Findings revealed that IM conversation significantly contributed to the well-being of distressed adolescents. In addition, participants’ level of introversion–extroversion moderated the degree of their perceived emotional relief, so that introverted participants profited from IMing more than did extraverts. The implications of these findings are discussed in the context of online communication theory, as well as the practical implementations for troubled adolescents.     

Effects of attitudes and behaviours on learning mathematics with computer tools

This mixed-methods study investigates the effects of student attitudes and behaviours on the outcomes of learning mathematics with computer tools. A computer tool was used to help students develop the mathematical concept of function. In the whole sample (N = 521), student attitudes could account for a 3.4 point difference in test scores between individuals on a 10-point scale. General attitude towards mathematics positively predicted test scores. However, more able students who were well-disposed towards mathematical computer tools achieved lower scores. Self-reported behaviours were unrelated to test scores. Detailed observation of a small number of students (N = 8) revealed that positive attitudes towards mathematics and mathematical computer tools augmented exhibited learning behaviours, and that both a positive attitude to mathematical computer tools and exhibited learning behaviours benefited tool mastery. Although tool mastery and test scores are intimately related, reflective processes appear to mediate this relationship. Promoting learning with mathematical computer tools needs to take several factors into account, including improving student attitudes, raising levels of learning behaviours, and giving sufficient opportunity for constructing new mathematical knowledge within meaningful mathematical discourse.     

Understanding moderating effects of collectivist cultural orientation on the knowledge sharing attitude by email

This paper investigates the moderating effects of collectivist cultural orientation introduced in the information systems and knowledge management (KM) literature to fully understand the important factors and relationships in knowledge sharing in the online learning environment. Social norms and collectivist cultural orientation are hypothesized as direct and moderating factors to the system users’ (or learners’) attitude toward sharing knowledge by email. An empirical test of large student samples (n = 566) with multiple cultural backgrounds in the most diverse university was implemented by PLS. The test confirmed that collectivist cultural orientation moderates the effects of social norms on the attitude toward sharing knowledge by email. Furthermore, the test results show that group norms are stronger than the instructor or classmate norms. Theoretical and practical implications of these findings for online learning and KM are discussed in the paper.     

Scaffolding of small groups�� metacognitive activities with an avatar

Metacognitive scaffolding in a computer-supported learning environment can influence students’ metacognitive activities, metacognitive knowledge and domain knowledge. In this study we analyze how metacognitive activities mediate the relationships between different avatar scaffolds on students’ learning. Multivariate, multilevel analysis of the 51,339 conversation turns by 54 elementary school students working in triads showed that scaffolding has an effect on students’ learning. Students receiving structuring or problematizing metacognitive scaffolds displayed more metacognitive knowledge than students in the control group. Metacognitive activities mediated the effects of scaffolding, and increased metacognitive activities supported students’ metacognitive knowledge. Moreover, students who were engaged in proportionately more cognitive activities or fewer off-task activities also outperformed other students on the metacognitive knowledge test. Only problematizing scaffolds led to more domain knowledge and metacognitive activities mediated the effects of the problematizing scaffolds. Moreover, students in the problematizing condition who engaged in more cognitive activities or whose group mates used more relational activities had greater domain knowledge acquisition than other students.     

Advancing young adolescents’ hypothesis-development performance in a computer-supported and problem-based learning environment

Hypothesis development is a complex cognitive activity, but one that is critical as a means of reducing uncertainty during ill-structured problem solving. In this study, we examined the effect of metacognitive scaffolds in strengthening hypothesis development. We also examined the influence of hypothesis development on young adolescents’ problem-solving performance. Data was collected from sixth-grade students (N = 172) using a computer-supported problem-based learning environment, Animal Investigator. The findings of the study indicated that participants using metacognitive scaffolds developed significantly better hypotheses and that hypothesis-development performance was predictive of solution-development performance. This article discusses further educational implications of the findings and future research.     

The effect of multimedia discrepancies on metacognitive judgments

This study investigated undergraduate students’ metacognitive judgments while learning about complex science topics using multimedia material (text and graph). A within-subjects design was used to examine the effect of discrepancies on study-time allocation, metacognitive judgments and inference generation. There were three types of discrepancies: none, text (between two ideas in the text) and text and graph (between the text and graph). Forty (N = 40) participants completed 12 trials where they were asked to provide six judgments: Ease of Learning judgments (EOLs), immediate and delayed Judgments of Learning (JOLs) for both text and graph and Retrospective Confidence Judgments (RCJs). Overall, participants provided significantly lower JOLs for content that contained discrepancies but RCJs remained high across conditions. Discrepancies did not influence study-time allocation, but did significantly influence inference scores. Overall, results suggest that participants’ judgments are different for different aspects of multimedia content and may be based on the text.