The impact of paper-based,computer-based and mobile-based self-assessment on students' science motivation and achievement

The present study focuses on the implementation of a self - assessment procedure in a Physics class, extended during a seven weeks period in a European secondary level school. The researchers used three modes of assessment based on paper and pencil, computer-web and mobile devices respectively. The aim of the study is to investigate the effect of each mode of assessment on students' motivation and achievement. Analysis of pre- and post-motivation tests revealed a more positive motivational orientation of students towards computers and mobile devices as assessment delivery mediums. Also, student evaluation implemented after the phase of the experimental procedure showed a significant increase in learning achievement for low-achieving students who participated in the mobile-based and computer-based assessment. The positive effects of computers and mobile devices on students' learning motivation suggest that they can be used as a promising alternative to paper and pencil assessment procedures.     

Investigating e-learning system usage outcomes in the university context

This paper investigates the outcomes of e-learning systems adoption and use by conceptualizing three e-learning systems adoption outcome constructs namely perceived learning assistance, perceived community building assistance and perceived academic performance. Utilizing these constructs, the paper proposes a research model for assessing the possible outcomes of e-learning systems adoption and use. The study collected longitudinal survey data from 249 university students participating in hybrid courses using a popular learning management system, Moodle. Partial least squares (PLS) approach was then used to test the research model.The findings suggest that beliefs about perceived usefulness and perceived ease of use, and how an e-learning system is used influence students' perceived learning assistance and perceived community building assistance. In turn, perceived learning assistance and perceived community building assistance influence the students' perceived academic performance.     

English outside the academic sphere: A mobile-based context-aware comparison study on collaborative and individual learning

Context-aware ubiquitous learning (CAUL) technology provides language learners with interactive learning environments and has been found to increase learning effectiveness and self-efficacy due to student interaction, discussion and evaluation of the entire learning process. This study used a mobile-based ubiquitous learning system combined with a collaborative learning approach to develop Fitness-specific English listening and reading, and fitness knowledge. The researchers recruited two groups of participants, an individual learning group (N = 31) and a collaborative learning group (N = 30), and evaluated their learning performance via pre-and post-tests. In addition, a questionnaire explored the perceived usefulness, usability, follow-up intention of using the system and self-efficacy regarding fitness-specific English. The results show that both groups improved fitness-specific English in terms of listening and reading comprehension. Moreover, collaborative learning was found to facilitate fitness-specific knowledge, and those in the collaborative learning group improved their self-efficacy more than those in the individual learning group.     

Discrepancy between language learners and teachers concerns about emergency remote teaching

Emergency remote teaching refers to the unanticipated, involuntary shift to a virtual learning environment due to, for example, a natural disaster or political instability. The sudden nature of this transition creates additional challenges to effective learning. In this article, we investigate one such challenge, namely the potential for teacher–student miscommunication. We report on a study involving 674 language learners and 61 language teachers. The participants were asked to rate a number of education-related ١problems that could potentially arise in the context of emergency remote teaching. Learners rated these concerns in terms of the extent to which they had actually experienced them, while teachers were asked to rate the extent to which they perceived these to be concerns for their students. The results showed that teachers believed that students required additional training on using learning management systems, that students did not take online teaching seriously, and that emergency remote teaching would encourage students to cheat. Students disagreed with these statements (ds = 0.53–0.65). We discuss the implications of these teacher–learner discrepancies in light of the need for explicit guidelines and clearer expectations of students during online learning and assessment.     

Examining gender differences in attitudes toward interactive classroom communications systems (ICCS)

An interactive classroom communication system (ICCS) involves the use of remote devices that permit all students in a class to respond to multiple choice questions displayed on a LCD projector. After responses are clicked in, the results are instantly aggregated and displayed in chart form. The purpose of this study was to examine gender differences in attitudes toward ICCSs for 659 secondary school students. The initial results suggested that male students had significantly more positive attitudes than female students with respect to student involvement, assessment, and perceived learning. However, a number of these differences disappeared when computer comfort level and type of use were added as covariates. Male students still perceived that ICCSs improved the overall learning process more than female students regardless of computer comfort level or type of use.     

Relationship between perceived problem‐solving skills and academic performance of novice learners in introductory programming courses

Past research has shown that student problem‐solving skills may be used to determine student final exam performance. This study reports on the relationship between student perceived problem‐solving skills 1 1 Henceforth, for brevity, we drop the word “perceived” in “student perceived problem‐solving skills” and use either “student perceived problem solving” or simply “student PSS.”
and academic performance in introductory programming, in formative and summative programming assessment tasks. We found that the more effective problem solvers achieved better final exam scores. There was no significant difference in formative assessment performances between effective and poor problem solvers. It is also possible to categorize students on the basis of problem‐solving skills, in order to exploit opportunities to improve learning around constructivist learning theory. Finally, our study identified transferability skills and the study may be extended to identify the impact of problem solving transfer skills on student problem solving for programming.     

Using U‐Pace instruction to improve the academic performance of economically disadvantaged undergraduates

This study was undertaken to evaluate whether the student success associated with the U‐Pace instructional approach, which integrates mastery‐based learning with proactive instructor support in an online learning environment, would replicate for both economically disadvantaged students and students who are not economically disadvantaged. Undergraduates were enrolled in U‐Pace (intervention) or comparison sections of a gateway course at two universities with different learning management systems. Course content was held constant. At both universities, intervention students earned a significantly greater percentage of objectively determined final grades of A or B. This academic success was found for both economically disadvantaged intervention students and intervention students who were not economically disadvantaged. Improvement from the beginning to the end of the semester in intervention students' rate of mastering concepts was found at University 1, but not at University 2. The assessment of learning conducted at University 1, independent of final course grades, showed that intervention students scored significantly higher on the proctored cumulative exam than comparison students. Findings suggest that the U‐Pace instructional intervention holds promise for increasing the success of undergraduates regardless of economic status.     

Determinants of students’ continuance intention to use blogs to learn: an empirical investigation

This study examines factors influencing students’ continuance intention to use blogs to learn in an undergraduate-level course. The research uses constructs from relevant theoretical frameworks, including the technology acceptance model, social cognitive theory, innovation diffusion theory, and expectation–confirmation model. A survey administered to 108 university students in a Canadian university was analysed using the partial least squares technique. The results show that perceived usefulness and perceived compatibility have positive effects on students’ attitudes towards blog use; perceived ease of use did not. Perceived compatibility, perceived self-efficacy, and perceived support for enhancing social ties with blogs have significant effects on the positive impacts of learning with such tools. Attitude and positive impacts of learning with blogs influence satisfaction with blog use. Both attitude and satisfaction are determinants of students’ continuance intention to use blogs to learn. Satisfaction with blog use is the main predictor of continued use intention.     

Assessing the determinants of flow experience in the adoption of learning management systems: the moderating role of perceived institutional support

Information technology has moved the focus of students and instructors from blackboards to online learning platforms. In the emerging e-learning revolution, the success of quality education depends on the right use of information and communication technology, including the creation of participants’ flow experience while using learning systems, which are rightly considered a backbone of contemporary education. There is a gap in the e-learning literature, reflecting a lack of understanding of students’ flow experience while using online interactive systems. This paper presents a study investigating the key factors (interpersonal factors and atmospheric cues) affecting flow experience and highlights its massive role in the use of any learning management system (LMS). Moreover, the study examines the moderating role of perceived institutional support (PIS) on student adoption of LMS. Using a survey, data were collected from university students in Pakistan and the data were analysed through structural equation modelling. We found that interpersonal factors and LMS atmospherics have significant effects on the flow experience. It was also found that PIS moderates the relationship between flow experience and the use of LMS. This study contributes to the literature by helping institutions and policy-makers know key factors of effective learning systems that students value and enjoy.     

Using online assessments to stimulate learning strategies and achievement of learning goals

The main goals of this research are: (i) to explore the influence that announcement of certain type of online assessment has on students' learning strategies and (ii) to explore the influence of stimulated learning strategies on achievement levels that students exhibit during assessments. Research has been conducted by testing and surveying 351 students from higher education institutions. Results indicate that students' learning strategies can be influenced in a relatively short period of time by announcing various types of online assessments and that steering to more desirable deep learning strategies has positive impact on both formal and perceived levels of success in achieving the desired learning goals. These findings can be used to create a novel adaptive online assessment system that incorporates the elements of adaptivity within a series of assessments and uses post-assessment feedback to steer students’ learning strategies.     

Behavioral intention,use behavior and the acceptance of electronic learning systems: Differences between higher education and lifelong learning

Widespread implementation of e-learning systems – learning management systems, virtual learning environments – across higher education institutions has aroused great interest on the study of e-learning acceptance. Acceptance studies focus on the predictors of system adoption and use, with behavioral intention to use the system as a proxy for actual use. This study proposes a TAM3-based model – with the inclusion of two additional variables: personal innovativeness in the domain of information technology and perceived interaction – to study the factors influencing the acceptance of e-learning systems. Attention is also brought towards the role of behavioral intention, especially in its relation with use behavior. In order to do so, two different settings were considered: higher education and lifelong learning; data was gathered from a survey administrated to Spanish graduate and lifelong learning students, and partial least squares analysis was used to test the research model. Results supported TAM relations, except for the intention-behavior linkage, and unveiled a dual nature of perceived usefulness – with one component related to efficiency and performance, and another component related to flexibility. The adequacy of applying TAM3-based models in educational contexts and suitability of actual system usage measures are also discussed.     

Examining effectiveness of communities of practice in online English for academic purposes (EAP) assessment in virtual classes

The literature on English for academic purposes (EAP) methodology highlights the significance of learners' engagement in learning language (Hyland, 2006) in mainstream general and online contexts. Blogs have been recommended in many studies as having the potential to bring the sense of community and collaboration in online classes. Therefore, this study sought to investigate whether blogs in large classes would help students enhance their perceptions of learning. To this end, Forty-two undergraduate students of Information Technology (IT) at an Iranian university participated in a weblog writing course in order to promote collaboration and reflective learning. Instrumentation included a questionnaire of perceived learning and sense of community, semi-structured interviews, and participant observations. The findings revealed a significant difference in perceived learning between the students with low sense of community and those with a high sense of community. Based on the qualitative findings of the study, we suggest an assessment framework incorporating constructivist and social-interactionist theories of learning in order to treat students as members of a community of learning. The findings may promise implications for gearing EAP assessment to more collaborative modes in online courses and suggest a model framework for the assessment of students in EAP online classes.     

On-line peer assessment and the role of the peer feedback: A study of high school computer course

The purposes of this study were to explore the effects and the validity of on-line peer assessment in high schools and to analyze effects of various types of peer feedback on students. The participating students, a total of 184 10th graders, developed their individual course projects by involving the on-line peer assessment learning activities in a computer course. The peer assessment activities consisted of three rounds, and each of the students acted as an author and a reviewer. Research data as evaluated from peers and experts indicated that students significantly improved their projects as involving the peer assessment activities. The scores determined by the learning peers were highly correlated with those marked by the experts, indicating that peer assessment in high school could be perceived as a valid assessment method. Moreover, this study also examined the relationships between the types of peer feedbacks in which students obtained from peer assessment and the subsequent performance of their projects. We categorized peer feedbacks into four types: Reinforcing, Didactic, Corrective and Suggestive. It was found that Reinforcing peer feedback was useful in helping students’ development of better projects; however, Didactic feedback and perhaps Corrective feedback provided by peers might play an unfavorable role for subsequent improvement of students’ projects. The Suggestive feedback may be helpful in the beginning of peer assessment activities; however, in the later parts of peer assessment, the effect of this type of feedback on learning might not be significant.     

Analytics of learning tactics and strategies in an online learnersourcing environment

Background

The use of crowdsourcing in a pedagogically supported form to partner with learners in developing novel content is emerging as a viable approach for engaging students in higher-order learning at scale. However, how students behave in this form of crowdsourcing, referred to as learnersourcing, is still insufficiently explored.

Objectives

To contribute to filling this gap, this study explores how students engage with learnersourcing tasks across a range of course and assessment designs.

Methods

We conducted an exploratory study on trace data of 1279 students across three courses, originating from the use of a learnersourcing environment under different assessment designs. We employed a new methodology from the learning analytics (LA) field that aims to represent students' behaviour through two theoretically-derived latent constructs: learning tactics and the learning strategies built upon them.

Results

The study's results demonstrate students use different tactics and strategies, highlight the association of learnersourcing contexts with the identified learning tactics and strategies, indicate a significant association between the strategies and performance and contribute to the employed method's generalisability by applying it to a new context.

Implications

This study provides an example of how learning analytics methods can be employed towards the development of effective learnersourcing systems and, more broadly, technological educational solutions that support learner-centred and data-driven learning at scale. Findings should inform best practices for integrating learnersourcing activities into course design and shed light on the relevance of tactics and strategies to support teachers in making informed pedagogical decisions.     

How does the smartphone usage of college students affect academic performance?

The present study aims to investigate the effects of smartphone use by college students on their perceived academic performance. Using five hypotheses derived from the literature related to smartphone use, the initial model was set up for path analysis to reveal the relationships among variables regarding college students' smartphone use in the academic setting. Moreover, multiple group analyses were additionally conducted to verify whether students exhibited different relationships in the hypothesized model depending on their majors. The results from path analyses showed that all path coefficients were positive and statistically significant, which indicated that all five hypothesized paths were supported. Above all, the results from multiple group analysis showed that one path (from Behavioural Intention to Use Smartphone to Academic Performance) differed significantly across groups. The findings from the current study provide educational policymakers and educators with information on how smartphone utilization in learning activities influences students' academic performance.     

On-line peer assessment and the role of the peer feedback: A study of high school computer course

The purposes of this study were to explore the effects and the validity of on-line peer assessment in high schools and to analyze effects of various types of peer feedback on students. The participating students, a total of 184 10th graders, developed their individual course projects by involving the on-line peer assessment learning activities in a computer course. The peer assessment activities consisted of three rounds, and each of the students acted as an author and a reviewer. Research data as evaluated from peers and experts indicated that students significantly improved their projects as involving the peer assessment activities. The scores determined by the learning peers were highly correlated with those marked by the experts, indicating that peer assessment in high school could be perceived as a valid assessment method. Moreover, this study also examined the relationships between the types of peer feedbacks in which students obtained from peer assessment and the subsequent performance of their projects. We categorized peer feedbacks into four types: Reinforcing, Didactic, Corrective and Suggestive. It was found that Reinforcing peer feedback was useful in helping students’ development of better projects; however, Didactic feedback and perhaps Corrective feedback provided by peers might play an unfavorable role for subsequent improvement of students’ projects. The Suggestive feedback may be helpful in the beginning of peer assessment activities; however, in the later parts of peer assessment, the effect of this type of feedback on learning might not be significant.     

Collaborative Online Examinations: Impacts on Interaction, Learning, and Student Satisfaction

This paper presents the results of a field experiment on online examinations facilitated by collaboration support systems. In particular, it examines collaborative learning and virtual teams through online examinations as an assessment procedure, compared to traditional examinations. Assessment is increasingly regarded as an important part of the learning process. Applying constructivism and collaborative-learning theories, the collaborative examination process features students' active participation in various phases of the exam process through small group activities online. A 1 times 3 field experiment evaluated the collaborative online exam compared with the traditional in-class exam, and the participatory exam, where students participated in the online exam processes without groups. Data analysis using results from 485 students indicates that collaborative examinations significantly enhance interactions and the sense of an online learning community and result in significantly higher levels of perceived learning     

The efficacy of a World-Wide Web mediated formative assessment

Abstract  Two studies evaluated the effectiveness of a WWW-based formative assessment package used in undergraduate psychology courses. Students taking on-line multiple-choice tests received instant feedback on areas of weakness and how to address them. In Study 1, students used the package as an integral part of their course syllabus. Level of use correlated with performance in the end-of-course summative assessment. In Study 2, the package was used as an 'optional extra'. Both studies found that students who used the package performed better than those who did not. Such systems may be useful learning tools which students may use to enhance performance.     

Multi-dimensional students’ evaluation of e-learning systems in the higher education context: An empirical investigation

There has been little research on assessment of learning management systems (LMS) within educational organizations as both a web-based learning system for e-learning and as a supportive tool for blended learning environments. This study proposes a conceptual e-learning assessment model, hexagonal e-learning assessment model (HELAM) suggesting a multi-dimensional approach for LMS evaluation via six dimensions: (1) system quality, (2) service quality, (3) content quality, (4) learner perspective, (5) instructor attitudes, and (6) supportive issues. A survey instrument based on HELAM has been developed and applied to 84 learners. This sample consists of students at both undergraduate and graduate levels who are users of a web-based learning management system, U-Link, at Brunel University, UK. The survey instrument has been tested for content validity, reliability, and criterion-based predictive validity. The analytical results strongly support the appropriateness of the proposed model in evaluating LMSs through learners’ satisfaction. The explanatory factor analysis showed that each of the six dimensions of the proposed model had a significant effect on the learners’ perceived satisfaction. Findings of this research will be valuable for both academics and practitioners of e-learning systems.