Constructing and evaluating online goal-setting mechanisms in web-based portfolio assessment system for facilitating self-regulated learning

The purpose of the present study was to construct goal-setting mechanisms in a web-based portfolio assessment system (WBPAS), based on the self-regulated learning (SRL) process proposed by Zimmerman, and to examine effects of these mechanisms on SRL. The participants were two classes of 11th graders taking the website design class in a vocational high school. The participants were assigned randomly to either an experimental group (n = 40) learning with a WBPAS or a control group (n = 41) learning with a paper-based portfolio. The study results revealed the following: a) the quality of goal-setting mechanisms may facilitate SRL. b) Students setting learning goals with the WBPAS demonstrated significantly better SRL than students setting learning goals with the paper-based portfolio.     

Intensive use of ICT in school: Developing differences in students’ ICT expertise

The purpose of the study was to examine the development of students’ high-level computer skills and competence (student expertise) in information and communication technology (ICT), and to examine the characteristics of such expertise. Eighteen lower secondary school students, selected to represent both genders and all school achievement levels, were given laptops for three years to be used both at school and at home. The data of the longitudinal study consisted of a test on ICT skills; self-evaluation questionnaires on ICT competence, thoughts about their own expertise, ICT-related activities and task, interest in ICT, and classroom observations. The results of the study indicated that the intensive use of ICT and the process-oriented learning environment supported the development of student expertise. In the analysis, three groups were identified, which oriented themselves somewhat differently in relation to ICT: student experts (n = 6), advanced users (n = 8) and non-interested users (n = 4). The experts differed from the other groups in respect of especially focusing on advancing their ICT skills; they had undertaken ICT-related tasks outside the school, they had metacognitive consciousness about their competence, and they had future plans concerning ICT in their further education and profession.     

The effect of functional roles on perceived group efficiency during computer-supported collaborative learning: a matter of triangulation

In this article, the effect of functional roles on group performance and collaboration during computer-supported collaborative learning (CSCL) is investigated. Especially the need for triangulating multiple methods is emphasised: Likert-scale evaluation questions, quantitative content analysis of e-mail communication and qualitative analysis of open-ended questions were used. A comparison of 41 questionnaire observations, distributed over 13 groups in two research conditions – groups with prescribed functional roles (n = 7, N = 18) and nonrole groups (n = 6, N = 23) – revealed no main effect for performance (grade). Principal axis factoring of the Likert-scales revealed a latent variable that was interpreted as perceived group efficiency (PGE). Multilevel modelling (MLM) yielded a positive marginal effect of PGE. Most groups in the role condition report a higher degree of PGE than nonrole groups. Content analysis of e-mail communication of all groups in both conditions (role n = 7, N = 25; nonrole n = 6, N = 26) revealed that students in role groups contribute more ‘coordination’ focussed statements. Finally, results from cross case matrices of student responses to open-ended questions support the observed marginal effect that most role groups report a higher degree of PGE than nonrole groups.     

Construction of an instrument to measure student information and communication technology skills,experience and attitudes to e-learning

Over the past 20 years self-report measures of healthcare students’ information and communication technology skills have been developed with limited validation. Furthermore, measures of student experience of e-learning emerged but were not repeatedly used with diverse populations. A psychometric approach with five phases was used to develop and test a new self-report measure of skills and experience with information and communication technology and attitudes to computers in education. Phase 1: Literature review and identification of key items. Phase 2: Development and refinement of items with expert panel (n = 16) and students (n = 3) to establish face and content validity. Phase 3: Pilot testing of draft instrument with graduate pre-registration nursing students (n = 60) to assess administration procedures and acceptability of the instrument. Phase 4: Test–retest with further sample of graduate pre-registration nursing students (n = 70) tested stability and internal consistency. Phase 5: Main study with pre-registration nursing students (n = 458), further testing of internal consistency. The instrument proved to have moderate test–retest stability and the sub-scales had acceptable internal consistency. When used with a larger, more diverse population the psychometric properties were more variable. Further work is needed to refine the instrument with specific reference to possible cultural and linguistic response patterns and technological advances.     

Teacher value beliefs associated with using technology: Addressing professional and student needs

Studies have indicated that when teachers believe technology uses are valuable, they are more likely to incorporate those uses into their practices. This hermeneutical phenomenology study investigated the value beliefs that underlie teachers’ uses of technology. To measure value beliefs, teachers’ uses (and reasons for those uses) of technology for teaching and learning were examined. Data were collected from eight award-winning teachers through an interview, observation, and electronic portfolio. Findings indicated that teachers used technology to address professional (e.g., creating customized classroom materials, improving classroom management by engaging students) and student needs (e.g., enhancing student comprehension, equipping students with technology skills), all of which related to the underlying value belief of promoting student learning. Based on these findings, professional development activities should emphasize the potential impact of specific technology uses on student learning.     

Do students need teacher’s initiation in online collaborative learning?

As more and more people use computers to complete their work and solve problems in the workplace, computing education is emphasized for students of all levels and disciplines in Taiwan. However, the computing education in Taiwan can hardly be recognized as effective and satisfactory. Many inappropriate examples that lack context are used in teaching and textbooks that may result in employees with low competence and insufficient ability for collaborative working. Students who grow up in this learning context usually lack the ability to seek information and solve problems by themselves. In this regard, the author redesigned a course and adopted online collaborative learning with initiation to establish the essential knowledge for students’ collaboration in the initial stage of a course. This study conducted an experiment that included 169 undergraduates from three class sections – the first two from an academic university (Case 1, n = 68; Case 2, n = 68) and the last one from a university of science and technology (Case 3, n = 33) – taught by the same teacher under the same course name and the same course website. The results show that students who received online collaborative learning with initiation had higher grades than those without. The author further discusses the implications for teachers, schools, and scholars who plan to provide online courses for their students, particularly computing courses.     

Developing Web-based assessment strategies for facilitating junior high school students to perform self-regulated learning in an e-Learning environment

This research refers to the self-regulated learning strategies proposed by Pintrich (1999) in developing a multiple-choice Web-based assessment system, the Peer-Driven Assessment Module of the Web-based Assessment and Test Analysis system (PDA-WATA). The major purpose of PDA-WATA is to facilitate learner use of self-regulatory learning behaviors to perform self-regulated learning and in turn improve e-Learning effectiveness. PDA-WATA includes five main strategies: ‘Adding Answer Notes,’ ‘Stating Confidence,’ ‘Reading Peer Answer Notes,’ ‘Recommending Peer Answer Notes’ and ‘Querying Peers’ Recommendation on Personal Answer Notes’. Using these strategies, examinees are allowed to add answer notes to explain why they chose a certain option as the correct answer and state their confidence in their own answer and answer notes, for peers’ reference. In addition to reading peer answer notes, examinees can also recommend peer answer notes as valuable references. The recommendation information can also be queried by all examinees. Quasi-experimental design was adopted to understand the effectiveness of PDA-WATA in facilitating learner use of self-regulatory learning behaviors to perform self-regulated learning and in improving learner e-Learning effectiveness. Participants were 123 seventh-grade junior high school students from four classes. These four classes were randomly divided into the PDA-WATA group (n = 63) and the N-WBT group (n = 60). Before e-Learning instruction, all students took the pre-test of the Learning Process Inventory (LPI), used to understand how often learners use self-regulatory learning behaviors in the learning process, and the pre-test of the summative assessment. After a two-week e-Learning instruction, the students all took the post-test of the LPI and the summative assessment. Results indicate that students in the PDA-WATA group appear to be more willing to take the Web-based formative assessment than students in the N-WBT group. In addition, PDA-WATA appears to be significantly more effective than N-WBT in facilitating learner use of self-regulatory learning behaviors to perform self-regulated learning and in improving their e-Learning effectiveness. Moreover, this research also finds that in the PDA-WATA group, there is no significant difference between the learning effectiveness of students with a low level of self-regulated learning and students with a high level of self-regulated learning, but similar result cannot be found in the N-WBT group.     

ABRACADABRA in the hands of teachers: The effectiveness of a web-based literacy intervention in grade 1 language arts programs

This study explored how teacher variations in use of a web-technology of known effectiveness, affected growth in literacy. Teachers used ABRACADACABRA (ABRA) (http://grover.concordia.ca/abra/version1/abracadabra.html), in Grade 1 Language Arts classes. Children (N = 60) across three classrooms were exposed to ABRA activities and a control class followed the regular provincial literacy program. Interventions were run by briefly-trained teachers for a total of 16 h. Each teacher chose to use the program in qualitatively distinct ways that corresponded to the first three stages of Sandholtz, Ringstaff, and Dwyer’s (1997) technology integration model, namely: Entry, Adoption and Adaptation. Growth in literacy between pre- and post-test revealed significant differences associated with technology integration style across all measures of literacy and related language skills. The largest and most-widespread effects were evident for the Adaptation group that linked technology content to wider learning themes in the classroom. In terms of overall growth in standardised literacy scores across all six such measures used, Adaptation proved to be 60% more effective than Adoption. Results suggest that explorations of exactly how teachers use technology have important implications for practice as well as for the interpretation of field-based studies of the effectiveness of educational technology.     

Effects of attitudes and behaviours on learning mathematics with computer tools

This mixed-methods study investigates the effects of student attitudes and behaviours on the outcomes of learning mathematics with computer tools. A computer tool was used to help students develop the mathematical concept of function. In the whole sample (N = 521), student attitudes could account for a 3.4 point difference in test scores between individuals on a 10-point scale. General attitude towards mathematics positively predicted test scores. However, more able students who were well-disposed towards mathematical computer tools achieved lower scores. Self-reported behaviours were unrelated to test scores. Detailed observation of a small number of students (N = 8) revealed that positive attitudes towards mathematics and mathematical computer tools augmented exhibited learning behaviours, and that both a positive attitude to mathematical computer tools and exhibited learning behaviours benefited tool mastery. Although tool mastery and test scores are intimately related, reflective processes appear to mediate this relationship. Promoting learning with mathematical computer tools needs to take several factors into account, including improving student attitudes, raising levels of learning behaviours, and giving sufficient opportunity for constructing new mathematical knowledge within meaningful mathematical discourse.     

Self-regulated learning through writing on computers: Consequences for reading comprehension

The overall aim for the present study was to analyze the consequences for reading ability among the children of a computer supported self-regulated learning environment in grade two. By means of a quasi-experimental design in a natural setting, an experimental group (n = 39) was compared to a control group from a national sample (n = 3409) on reading comprehension. The statistical analyses showed that the experimental group achieved better on reading comprehension both as a group (p < .001) as well as girls (p < .001) and boys (p < .05) separately. The proportion of high achievers was higher, and the proportion of low achievers was lower in the experimental group. In order to explain the level of reading comprehension in the experimental group Structural Equation Modelling (SEM) was used. The main explanatory factor for reading comprehension was writing with β = .44. As a tentative conclusion it was suggested that the extended writing in combination with the self-regulated learning environment can promote reading comprehension in grade two, whereas home literacy had no impact on reading comprehension in this context.     

Qualitative findings of students’ perception on practice of self-regulated strategies in online community discussion

With rapid emergence to the birth of the knowledge era, an active and interactive learning environment is fundamental to any teaching and learning process. Over time, negative implications of traditional learning environment are mounting, and measures must be taken to challenge it. With extensive research on available learning tools, it has become more feasible to provide our students with better learning opportunities. Such was the anticipation in the Malaysian educational context. Hence, this paper aims to address qualitative findings of a study on self-regulated learning strategies conveyed through the proposed interactive e-learning community (iELC). In duration of eight weeks, students (n = 50) from regular national secondary schools were subjected to online learning tasks aimed to advance strategies on self-regulated learning. To date, strategies of self-regulated learning have been perceived as key to learner to succeed academically and after the schooling years. By means of semi-structured interview, data were collected from small group and one-to-one perception. Results were directed at the overall development of self-regulated learning strategies and its diffusion in the iELC discussion platform. Conclusively, these findings add significantly to the understanding of self-regulated learning strategies in an online learning environment.     

Investigating ICT using problem-based learning in face-to-face and online learning environments

This article reports on the design, implementation and evaluation of a module in the MEd (Business) in the Faculty of Education at the University of Hong Kong in which an explicit problem-based learning (PBL) approach was used to investigate the challenges associated with the adoption and use of information and communication technologies (ICT) in Hong Kong secondary school classrooms. PBL influenced both the way the curriculum was developed and the process by which students (n = 18) investigated topics related to the integration of ICT in business studies classrooms. The evaluation was based on five evaluative questions dealing with the implementation of PBL, the extent to which PBL facilitated academic discourse, the extent of ‘new’ knowledge about ICT that had been created, the role of the tutor, and the online learning environment provided. The evaluation revealed that PBL provided a practical approach to investigating ICT in both face-to-face and online learning environments, leading to ‘new’ knowledge about challenges associated with the adoption and use of new technologies in various educational settings.     

Using mobile communication technology in high school education: Motivation,pressure, and learning performance

Motivation and pressure are considered two factors impacting vocational senior high school student learning. New communication technology, especially mobile communication technology, is supposed to be effective in encouraging interaction between the student and the instructor and improving learning efficiency. Social presence and information richness theory was applied to analyze the media and their impacts on the instruction process firstly. Then the author observed firstly the impact of using individual communication technologies – namely Short Message Service (SMS), email, and online forum – on student learning motivation, pressure, and performance, based on a comparative investigation of 176 students. Then the impacts of using combination of mobile and Internet communication technology – SMS + email, SMS + online forum – were examined with another experiment of 45 students. The result showed that instant messaging helps bonding the two roles – student and instructor – in the instruction process effectively. When combined with Internet communication media, it can significantly increase student extrinsic motivation without causing higher pressure. Additionally, communication media demanding public expression rather than private dialogue should be adopted with careful consideration, since they may raise student pressure.     

Improving literacy skills through learning reading by writing: The iWTR method presented and tested

Learning to read and write is a basic skill that unfortunately not everybody acquires sufficiently. Lack of teachers and time in school are some of the reasons, but in addition the enormous rise in informational activities due to the Internet and other information technology-enabled opportunities has made literacy skills increasingly important to ever more people. This means literacy education must be improved so more children in the world get better chances. In order to contribute to developing better methods for learning to read and write in early years this study tests a new method developed to improve reading and writing learning in early ages. The ICT (Information and communication technologies) supported “Integrated Write to Learn” (iWTR) method lets children in 1st grade use computers and other ICT tools to write texts and subsequently discuss and refine them together with class mates and teachers. Handwriting is postponed to 2nd grade. While the traditional method requires students to go through two development processes in parallel, a cognitive (learning to read and) a motor (learning to write with a pencil), iWTR works with one process at a time, first cognitive development, then (from grade 2) motor skills training. iWTR extends previous WTR methods by more social work methods using a web site and peer comment for providing social meaning and feedback.The method was tested using two test groups and two control groups (total n = 87) by systematically measuring performance in reading and writing using standard tests in combination with observations and student evaluation to assess social and individual effects of work methods.The results show that while reading skills were improved considerably the biggest improvement concerned writing skills. Students in the test group wrote longer texts with better structure, clearer content, and a more elaborate language.     

Performance measures in courses using computer-aided personalized system of instruction

Archived data from four courses taught with computer-aided personalized system of instruction (CAPSI) – an online, self-paced, instructional program – were used to explore the relationship between objectively rescored final exam grades, peer reviewing, and progress rate – i.e., the rate at which students completed unit tests. There was a strong positive correlation (r = .68, p < .01) between rate of progress and the amount of peer reviewing students did. This was predictable because peer reviewers had to be further along in the course than the students whose unit tests they reviewed. Students who completed all the units tended to obtain higher final exam scores than those who did not. For students who completed all the units there was little difference between the final exam performance of those who had a high progress rate and those who had a low progress rate. Considering all students together there was a moderate correlation between progress rate and final exam performance (r = .36, p < .01). In addition, there was a moderate positive correlation (r = .33, p < .01) between the amount of peer reviewing students did and their performance on the final exam. This correlation was substantially reduced (r = .13, p < .20) when rate of progress was partialed out. Thus, overall, students who progressed more rapidly through the course did more peer reviewing and learned more as measured by final exam performance. Interestingly, there were students who showed good learning without much participation in course related behaviors such as completing unit tests and peer reviewing. It is concluded that the CAPSI instructional program provides a good learning environment for students who utilize its components but it also accommodates other learning styles. In addition, there may be a distinction between students who complete all assigned units and those who do not regardless of their tendencies to procrastinate.     

Reflections on iCODE: using web technology and hands-on projects to engage urban youth in computer science and engineering

More than 200 middle school and high school students from underserved urban communities in Boston, Lowell, and Lawrence, Massachusetts, participated in after-school and summer enrichment programs over a three-year period, using hands-on learning materials and web resources to complete hands-on microcontroller-based projects. Program content was based on a suite of robotics and electronics kits developed by the University of Massachusetts Lowell and Machine Science Inc., together with on-line instructions, a web-based programming tool, and a shared electronic portfolio of student projects. Participating students worked with classroom teachers and undergraduate mentors to complete a series of projects, and took part each year in a non-competitive robotics exhibition and a competitive robot sumo tournament. Goodman Research Group assessed learning outcomes and attitudinal changes using a variety of measures, including observations of program sessions, group interviews with participating students, pre- and post-program student surveys, and educator feedback. The program was found to effectively engage participants, give them real engineering and programming skills, improve their attitudes toward science, technology, engineering, and mathematics (STEM) subjects, and increase their interest in STEM career pathways. These results are presented, along with lessons learned from the program implementation, technology development, and evaluation.     

A conceptual framework mapping the application of information search strategies to well and ill-structured problem solving

Problem-based learning (PBL) is an instructional approach that is organized around the investigation and resolution of problems. Problems are neither uniform nor similar. 11 and 12 in his design theory of problem solving has categorized problems into two broad types – well-structured and ill-structured. He has also described a host of mediating skills that impact problem solving outcomes. The thrust of this paper rests in the argument that the basis of these mediating skills is information search literacy and particularly, in view of the utility of the Internet as an informational repository, effective information searching skills. This study was an investigation of how different Internet information seeking strategies can be used to engage in problem solving. A conceptual framework that explains how different Internet information searching strategies can be employed in successfully solving well and ill-structured problems was devised and empirically tested. The research site was a newly established polytechnic in Singapore that employs problem-based learning to support its curricular implementation. The sample population of students came from a class of 25 first-year students. The research findings of this study inform that information searching skills indeed play an important role in problem solving. The findings affirm the need for students to be systematically instructed in the skills of information searching to be able to accomplish problem solving. The information searching necessary for solving well-structured problems is constrained and readily manageable. Thus, students only have to be acquainted with fundamental information searching skills to solve well-structured problems. On the other hand, the information needs of ill-structured problems are usually complex, multi-disciplinary and expansive. Hence, students have to be trained to apply a more advanced set of information searching skills in resolving ill-structured problems.     

Cognitive load and science text comprehension: Effects of drawing and mentally imagining text content

One hundred and eleven 10th graders read an expository science text on the dipole character of water molecules (ca. 1600 words). Reading instruction was varied according to a 2 × 2 experimental design with factors ‘drawing pictures of text content on paper’ (yes, no) and ‘mentally imagining text content while reading’ (yes, no). The results indicate that drawing pictures, mediated through increased cognitive load, decreased text comprehension and, thus, learning (d = −0.37), whereas mental imagery, although decreasing cognitive load, increased comprehension only when students did not have to draw pictures simultaneously (d = 0.72). No evidence was found that the effects were moderated by domain-specific prior knowledge, verbal ability, or spatial ability. The results are in line with cognitive theories of multimedia learning, self-regulated learning, and mental imagery as well as conceptions of science learning that focus on promoting mental model construction by actively visualizing the content to be learned. Constructing mental images seems to reduce cognitive load and to increase comprehension and learning outcome when the mental visualization processes are not disturbed by externally drawing pictures on paper, whereas drawing pictures seems to increase cognitive load resulting in reduced comprehension and learning outcome.     

Motivation of computer based learning across adulthood

This research investigates learning motivation of young and old adults. In detail, we explore motives of young and old adults to participate in two ICT-course settings: e-learning and face-to-face courses. In a first study young (n = 53, M = 26.0 years) and old (n = 55, M = 69.8 years) participants of e-learning courses completed an online questionnaire on learning motivation and personality. In a second study young (n = 46, M = 26.7 years) and old (n = 57, M = 69.5 years) participants of face-to-face ICT courses completed the same learning motivation questionnaire and questions about personality, subjective age and life satisfaction. Exploratory factor analysis revealed four factors of learning motivation: belonging, instrumentality, personal growth, and competition. As expected, older adults expressed stronger motives of belonging and personal growth, and thus expressed a stronger interest in self-determined and intrinsic learning. Young adults, in contrast, strongly endorsed competitive-related motives of learning. Instrumentality was influenced by the interaction of age and subjective age; older participants showed higher instrumentality when the difference between chronological age and subjective age is big. Findings of this study shed new light on assumptions of socioemotional selectivity theory.     

E-portfolios supporting primary students' writing performance and peer feedback

E-portfolios show great promise for supporting students' writing performance and facilitating peer feedback, but empirical research of their use in primary education is limited. To address this gap, a yearlong study was conducted in a 4th grade primary class in Cyprus implementing e-portfolios (n = 20) to help students document their progress and send feedback to peers. A generic, open source weblog tool localized into Greek was used as an e-portfolio tool. Data sources included 176 student-essays, 1306 instances of peer feedback, students pre- and post-tests on writing performance, nine videotaped student interviews and one teacher interview. A paired samples t-test analysis showed that there was a statistically significant difference between students' pre-test (M = 62.6, SD = 9.82, n = 20) and post-test (M = 76.5, SD = 12.6, n = 20) on writing performance (t (19) = −8.03, p < .01). A repeated measures analysis of variance on e-portfolio artifacts showed that there were learning gains with respect to students' writing performance over time [F(4.01, 76.25) = 31.59, p < .01, η² = 0.89]. A qualitative analysis of students' comments showed that students provided more thorough peer feedback over time and became gradually more capable of providing corrective feedback. The qualitative analysis of student interviews provided evidence that students valued peer feedback in their portfolios. The analysis of the teacher interview showed that average and high-ability students benefited the most from peer feedback. This study provided evidence that e-portfolios can support the development of students' writing performance and peer feedback skills in the context of primary school essay writing. Instructional implications for portfolio implementation are offered.