A usability comparison of PDA-based quizzes and paper-and-pencil quizzes

In the last few years, schools and universities have incorporated personal digital assistants (PDAs) into their teaching curricula in an attempt to enhance students’ learning experience and reduce instructors’ workload. One of the most common uses of PDAs in the classroom is as a test administrator. This study compared the usability effectiveness, efficiency, and satisfaction of a PDA-based quiz application to that of standard paper-and-pencil quizzes in a university course. Effectiveness was measured as students’ quiz scores and through a mental workload questionnaire; efficiency was the time it took students to complete each quiz; and satisfaction was evaluated using a subjective user satisfaction questionnaire. The study showed the PDA-based quiz to be more efficient, that is, students completed it in less time than they needed to complete the paper-and-pencil quiz. No differences in effectiveness and satisfaction were found between the two quiz types. Computer anxiety was not affected by the quiz type. For these reasons, as well as other advantages to both students (e.g., real-time scoring) and teachers (e.g., less time spent on grading), PDAs are an attractive test administration option for schools and universities.     

What influences college students to continue using business simulation games? The Taiwan experience

Previous studies have pointed out that computer games could improve students’ motivation to learn, but these studies have mostly targeted teachers or students in elementary and secondary education and are without user adoption models. Because business and management institutions in higher education have been increasingly using educational simulation games in recent years, factors influencing the continuing use of business simulation games by higher-education students are worth probing into. This research adopted the technology acceptance model, expectation confirmation theory, and agency theory as its theoretical base. Moreover, learning motivation and classroom climate from the perspective of learning, as well as perceived attractiveness and perceived playfulness from the perspective of playfulness and attractiveness were also added to the final research model. A total of 185 valid student respondents in Taiwan’s higher education who have used business simulation games in their classes participated in the survey. The results show that perceived playfulness and learning performance positively influence students’ satisfaction, which further influence the intention to use computer simulation games. Furthermore, perceived ease of use and perceived attraction play a critical role in determining perceived playfulness. Perceived ease of use was also positively influenced by perceived attraction. The research results on the students’ perspective provide a strong support for the teachers to adopt or continue using computer simulation games in classrooms. However, the agency theory failed to be sustained as a useful tool in motivating students’ learning activities, which is worthy of further research.     

Students’ perceptions of teaching technologies, application of technologies, and academic performance

This study examined business students’ perceptions of four objectives (i.e., Enjoyment, Learning, Motivation, and Career Application) across five teaching technologies (i.e., Projector, PowerPoint, Video, the Internet, and Lecture), business professors’ effective application of technologies, and students’ academic performance. We collected data from 215 students at a regional state university in the USA. We developed Students’ Perceptions of Technology Scale, SPOTS, specifically for the present study, used the most rigorous criteria, and investigated reliability, convergent and discriminant validity, exploratory and confirmatory factor analysis, and measurement invariance of this scale. Mean scores revealed that Video conveyed the highest amount of Enjoyment. PowerPoint provided the highest amount of Learning and Motivation. The Internet provided the highest Career Application for future jobs. Younger students preferred Video, whereas older students favored Lecture. Regression results showed that the use of Video for Learning, Projector and Lecture for Enjoyment, PowerPoint for career and Motivation, and the Internet for Learning contributed to professors’ teaching effectiveness. Students’ high ratings for professors’ effective use of the Lecture method and low expectation for the use of a Projector predicted their self-reported GPA (academic performance). Professors may use a different mix of technologies in the classroom and use them creatively in order to promote the most Learning for students and satisfy students’ Learning needs and objectives.     

The implementation and evaluation of a mobile self- and peer-assessment system

Recently, more and more researchers have been exploring uses of mobile technology that support new instructional strategies. Based on research findings related to peer and self assessment, this study developed a Mobile Assessment Participation System (MAPS) using Personal Digital Assistants (PDAs) as the platform. In addition, the study proposes an implementation model of the MAPS that should facilitate the effectiveness of self- and peer-assessment in classrooms. The researcher argues that teachers and students can benefit from MAPS in various regards including more flexible assessment arrangement, more efficient use of time, and more opportunities for student reflection on learning and assessment. Thirty-seven students taking teacher-education courses with the researcher participated in this study, and these students employed the MAPS to conduct two-round assessment activities that would help these students assess both their own and one another’s final projects. Both the students’ valid responses in a survey herein and scores obtained from the assessment activities confirmed the benefits of the MAPS and its implementation model. Yet, the students voiced such concerns as the objectivity of peer-assessment and the difficulty of providing constructive feedback, and the correlation analysis indicated a lack of consistency between teacher-grading and student-grading.     

Scaffolding student-generated questions: Design and development of a customizable online learning system

Despite the fact that the benefits of student question generation are well documented, most students do not take part in question generation exercises during their formal schooling and are not accustomed to authoring questions. Under the premise that student question generation activities should be better supported in a timely, flexible and logistically feasible fashion, a customizable online learning environment that accentuates various scaffolding techniques has been designed and developed. The framework guiding the development of the system, and its associated designs, are described. To assess the various built-in scaffolds used to support students’ learning activities by means of question generation, a study was undertaken to that measured students’ perceived usefulness of each mechanism, as well as the effects of the perceived usefulness of the scaffolds on students’ attitudes toward question generation learning activities in general. The data collected indicated that, by utilizing computers and network technologies, the developed system provided a supportive learning environment for student’s question generation learning activities. Support features not yet included in other similar systems (including access to generic question stems with sample questions, access to model questions, two-way cyclic communication between authors of question and assessors, and the ability to conceal one’s real identity by anonymity or nickname, etc.), were confirmed to provide a high level of support. Recommendations for classroom implementations and future studies are offered.     

Finnish high school students’ readiness to adopt online learning: Questioning the assumptions

The Finnish high school system in rural areas is facing challenges because of a decreasing number of the students. This situation places new emphasis on online learning. Online learning offers new possibilities for high schools to provide equal learning opportunities for their students. This paper explores students’ readiness to adapt their studying habits in the networked high schools by outlining their beliefs about online learning. Beliefs are assumed to direct people’s actions, in this case activities concerning studying online. Three hundred second year high school students from Eastern Finland who had not had the experiences of learning online were studied. The findings suggest that students polarize into negative, neutral and positive groups based on their beliefs concerning online learning. Results also indicate that students’ knowledge about the possibilities of online learning is quite superficial. In contrast to theories about collaborative learning practices, students see online learning rather differently. Students with negative and neutral beliefs especially see online learning merely as a static “warehouse” of materials and study-alone learning tasks instead of offering possibilities for collaborative knowledge building.     

Information retention from PowerPoint and traditional lectures

The benefit of PowerPoint^™ is continuously debated, but both supporters and detractors have insufficient empirical evidence. Its use in university lectures has influenced investigations of PowerPoint’s effects on student performance (e.g., overall quiz/exam scores) in comparison to lectures based on overhead projectors, traditional lectures (e.g., “chalk-and-talk”), and online lectures. Thus far, comparisons of overall exam scores have yielded mixed results. The present study decomposes overall quiz scores into auditory, graphic, and alphanumeric scores to reveal new insights into effects of PowerPoint presentations on student performance. Analyses considered retention of lecture information presented to students without the presence of PowerPoint (i.e., traditional lecture), auditory information in the presence of PowerPoint, and visual (i.e., graphic and alphanumeric) information displayed on PowerPoint slides. Data were collected from 62 students via quiz and questionnaire. Students retained 15% less information delivered verbally by the lecturer during PowerPoint presentations, but they preferred PowerPoint presentations over traditional presentations.     

Developing and integrating courseware for oral presentations into ESP learning contexts

This study reports on the development of ESP (English for Specific Purposes) multimedia courseware on oral presentations, and its integration into self-study learning and elective courses for students with different English proficiencies, as one solution to problems in ESP courses in Taiwan. The courseware design is based on Mayer’s multimedia learning cognitive theory, and the language learning focus draws on Chapelle’s suggested criteria for development of multimedia CALL. Evaluation of student performance with two different formats for courseware integration is based upon data from pre- and post-tests for preparing speech texts, and a questionnaire survey. The courseware provides authentic materials with a logical situational layout and a friendly interface design for learning ESP for oral presentations in international business and technical settings and offers rich and flexible learning activities with corresponding on-line self-evaluation so that students actively engage in cognitive processing. Students with different English proficiencies have different concerns about giving a presentation. Meanwhile, after students’ self-study for six weeks, regardless of level of proficiency, students’ learning effectiveness and satisfaction with the courseware integration were significantly improved, by qualitative and quantitative analysis. Such students’ improvement suggests success of the courseware design and learning effectiveness with its integration.     

Personalized Learning Course Planner with E-learning DSS using user profile

Various methods of E-learning systems, based on information and communications, and geared towards improving learning effectiveness and students’ attention span, have been studied. However, most E-learning systems force students to follow the learning course or content established by a teacher. These methods are convenient, but they limit the effectiveness of E-learning.To overcome this limitation and increase effective learning, new techniques that reflect alternative learning styles, such as adaptive learning and personalized learning, have been studied. In this study, we proposed a Personalized Learning Course Planner (PLCP) that allows students to easily select the learning course they desire. User profile data was collected from the students’ initial priorities about learning contents as well as the test scores after their study. E-Learning Decision Support System (EL-DSS) in PLCP suggests an appropriate learning course organization, according to calculated results based on the user profile data.To verify the effectiveness of the proposed system, we implemented an English learning system consisting of PLCP. We conducted an experiment with 30 university students and evaluated students’ satisfaction by questionnaire analysis. The results indicate that the proposed system improved learning effectiveness and student satisfaction. Further investigation of the participants indicated that suggesting a learning course suitable for students’ previous test scores and priorities encouraged students to concentrate on the lesson.     

Multimedia application with animated cartoons for teaching science in elementary education

This study reports research findings on the use of animated cartoons in a multimedia application meant to evaluate their effectiveness in supporting teaching and learning in science. The researchers have developed a cartoon-style multimedia application whereas animated cartoons where designed from scratch using appropriate programs. The study was carried out in various elementary schools of Athens, Greece, and 179 pupils aged 10–11 years participated in it. The research results provide evidence that the use of animated cartoons significantly increases the young students’ knowledge and understanding of specific science concepts, which are normally difficult to comprehend and often cause misconceptions to them.     

Is students’ computer use at home related to their mathematical performance at school?

Recent research has provided evidence that students’ computer use at home is positively associated with their performance at school. However, most of the previous studies have failed to take into account the multiple determination of school performance and, in addition, to explain why using computers at home should benefit students’ academic achievement. The study described in this article takes a step towards filling this gap by circumventing the theoretical and methodological problems of previous research. First, we analyzed students’ home computer use and their performance in mathematics while accounting for other factors that have been found to affect students’ achievement. Second, we investigated possible differences in students’ school performance depending on how they used the computer. Based on the data from German students who took part in the Programme for International Student Assessment (PISA) in 2003, our results showed that students’ access to a computer was not linked with their performance in mathematics. In addition, it did not matter how often students used a computer at home. A positive effect on mathematical achievement was, however, observed for a small group of students who used the computer in a self-determined way that largely engaged them in problem-solving activities. Overall, the findings indicate that for the majority of students the computer had no substantial influence on their academic achievement. At the same time, the results are suggestive of ways in which performance in mathematics might be enhanced through the use of computers.     

Development and evaluation of a compartmental picture archiving and communications system model for integration and visualization of multidisciplinary biomedical data to facilitate student learning in an integrative health clinic

Information technology (IT) has the potential to improve the clinical learning environment. The extent to which IT enhances or detracts from healthcare professionals’ role performance can be expected to affect both student learning and patient outcomes. This study evaluated nursing students’ satisfaction with a novel compartmental Picture Archiving and Communications System (PACS) for the automatic object-oriented integration and visualization of heterogeneous biomedical data. The compartmental PACS was specially designed to support client assessment and clinical education in the integrative health clinic of a university, which is run by a multidisciplinary service team. The sample was 63 nursing students, who were asked to complete a series of realistic tasks using the compartmental PACS. Upon completing the tasks, the Computer System Usability Questionnaire (CSUQ) was administered to assess their satisfaction with the system. Results from data analysis showed that nursing students who completed the evaluation had a satisfactory experience with the system. The Information Quality subscale mean was the highest mean of the CSUQ subscales. This is an important finding as the multidisciplinary data visualization feature of the system provides a technology-enhanced learning environment that can support nursing students’ efforts to both organize and represent knowledge. Through the compartmental PACS, students are assisted in connecting relevant knowledge via various representations of medical data for the clinical conditions under study.     

Exploring user experiences as predictors of MMORPG addiction

The overuse of Massively Multiplayer Online Role Playing Games (MMORPGs) is becoming a significant problem worldwide, especially among college students. Similar to Internet addiction, the pathological use of MMORPG is a kind of modern addiction that can affect students’ lives on both a physical and a psychological level. The purpose of this study is to understand MMORPG addiction from a user experience design approach. We first developed a complete model that includes eleven factors (challenge, fantasy, curiosity, control, reward, cooperation, competition, recognition, belonging, obligation and role-playing) to represent users’ experience in MMORPGs. After that, we design a questionnaire to measure student’ gaming experience and level of addiction. Students’ demography information, including gender and game playing habits, was also collected. Four hundred and eighteen Taiwanese college students aged 18–25 years old took part in this online survey. Regression analysis was then conducted to evaluate the relative explanatory power of each variable, with addiction score as the dependent variable and the eleven user experience factors as the independent variables. The results of regression analysis reveal five critical factors (curiosity, role-playing, belonging, obligation and reward) that can be used to predict MMORPG addiction. In addition, this study also infers possible casual mechanisms for increasing college students’ level of addiction. The implications of our findings for both design and educational practitioners were also discussed.     

Breaking concept boundaries to enhance creative potential: Using integrated concept maps for conceptual self-awareness

The authors address the role of computer support for building conceptual self-awareness—that is, enabling students to think outside of concept boundaries in hope of enhancing creative potential. Based on meta-cognition theory, we developed an integrated concept mapping system (ICMSys) to improve users’ conceptual self-awareness in addition to applying concept mapping techniques in traditional learning scenarios. Since the ICMSys accommodates different perspectives, selected ideas made by peers are retained with the help of integrated concept map (ICMap) representations used as stimuli for reflective thinking. Results from a case study with 32 information management undergraduates indicate: (a) increased levels of conceptual self-awareness, (b) evidence of conceptual improvement in the students’ redrawn concept maps, (c) that ICMap viewing frequency exerted a positive impact on level of conceptual self-awareness, and (d) a significant correlation between level of conceptual self-awareness in redrawn personal concept maps and actual conceptual changes as determined by three experts. We describe student perceptions of the ICMSys in terms of comprehension practicality and conceptual self-awareness, and give suggestions for future research.     

Place presence, social presence, co-presence, and satisfaction in virtual worlds

This study investigated the relationship among three types of presences, including place presence, social presence, and co-presence in virtual worlds and their relationship with satisfaction and immersive tendencies of students. Students’ scores on a subjective questionnaire were analyzed. The results indicated that there was a significant relationship among the place presence, social presence, and co-presence. While social presence seemed to affect the satisfaction most, place and co-presence also affected students’ satisfaction in the virtual world. Moreover, immersive tendencies of the students were related to their place and co-presence but not to their social presence. Findings highlighted the important issues for the design of virtual world environments to increase presence and satisfaction of students.     

The nature, reception, and use of online peer feedback in higher education

This article focuses on the use of online interactive peer feedback in higher education and identifies the successful uptake of feedback as an important aspect. We investigate the link between the nature of students’ feedback, the way it is evaluated by the receiver, and its consecutive use for the revision of students’ products. Two separate studies were conducted to investigate the link between these three variables across different educational contexts and tools. Both studies showed a significant relationship between feedback containing concrete suggestions and a successful uptake of the feedback. Regarding the different tools that were used, these concrete suggestions were more often produced in the Annotation system than in the Blackboard discussion forum, the latter showing more evaluative forms of feedback. We also found significant relationships between elements of both the nature and the reception of feedback on the one hand, and the use of this feedback by the receiver on the other hand.     

Acceptance of Internet-based learning medium: the role of extrinsic and intrinsic motivation

This study is one of the few attempts to investigate students’ acceptance of an Internet-based learning medium (ILM). By integrating a motivational perspective into the technology acceptance model, our model captured both extrinsic (perceived usefulness and ease of use) and intrinsic (perceived enjoyment) motivators for explaining students’ intention to use the new learning medium. Data collected from 544 undergraduate students were examined through the LISREL VIII framework. The results showed that both perceived usefulness and perceived enjoyment significantly and directly impacted their intention to use ILM. Surprisingly, perceive ease of use did not posit a significant impact on student attitude or intention towards ILM usage. Implications of this study are important for both researchers and practitioners.     

Controlled experiment replication in evaluation of e-learning system’s educational influence

We believe that every effectiveness evaluation should be replicated at least in order to verify the original results and to indicate evaluated e-learning system’s advantages or disadvantages. This paper presents the methodology for conducting controlled experiment replication, as well as, results of a controlled experiment and an internal replication that investigated the effectiveness of intelligent authoring shell eXtended Tutor–Expert System (xTEx-Sys). The initial and the replicated experiment were based on our approach that combines classical two-group experimental design and with factoral design. A trait that distinguishes this approach from others is the existence of arbitrary number of checkpoint-tests to determine the effectiveness in intermediate states. We call it a pre-and-post test control group experimental design with checkpoint-tests. The gained results revealed small or even negative effect sizes, which could be explained by the fact that the xTEx-Sys’s domain knowledge presentation is rather novel for students and therefore difficult to grasp and apply in earlier phases of the experiment. In order to develop and improve the xTEx-Sys, further experiments must be conducted.