A case study on using prediction markets as a rich environment for active learning

In this paper, prediction markets are presented as an innovative pedagogical tool which can be used to create a Rich Environment for Active Learning (REAL). Prediction markets are designed to make forecasts about specific future events by using a market mechanism to aggregate the information held by a large group of traders about that event into a single value. Prediction markets can be used to create decision scenarios which are linked to real-world events. The advantages of this approach in the cognitive and affective domains of learning are examined. The unique ability of prediction markets to enable active learning in large group teaching environments is explored. Building on this theoretical work, a detailed case study is presented describing how a prediction market can be deployed as a pedagogical tool in practice. Empirical evidence is presented exploring the effect prediction market participation has on learners in the cognitive domain.     

The interplay between cognitive and motivational variables in a supportive online learning system for secondary physical education

A path model was used to test the unique and interactive effects of cognitive and motivational variables when learning in a supportive online learning system, Collaborative Inquiry System (CIS). In this student-centered learning environment, students interact with computer simulations and are assisted by online scaffolds intended to help them learn complex scientific concepts. The present study also explored the relationships between students’ motivational, cognitive, and metacognitive strategy use and online performance. In total, 178 tenth-grade students participated in the study. The statistical analyses revealed that students’ learning goals and cognitive preferences predicted metacognitive strategy use and later influenced their performance. Prior knowledge is a predictor of neither metacognitive strategy use nor learning goals and need for cognition, but is nevertheless an important determinant of online performance. Discussions on how to accommodate the different needs of students with varying levels of prior knowledge, goal orientation, and cognitive preference in a supportive learning system are provided based on the results.     

Development and evaluation of a compartmental picture archiving and communications system model for integration and visualization of multidisciplinary biomedical data to facilitate student learning in an integrative health clinic

Information technology (IT) has the potential to improve the clinical learning environment. The extent to which IT enhances or detracts from healthcare professionals’ role performance can be expected to affect both student learning and patient outcomes. This study evaluated nursing students’ satisfaction with a novel compartmental Picture Archiving and Communications System (PACS) for the automatic object-oriented integration and visualization of heterogeneous biomedical data. The compartmental PACS was specially designed to support client assessment and clinical education in the integrative health clinic of a university, which is run by a multidisciplinary service team. The sample was 63 nursing students, who were asked to complete a series of realistic tasks using the compartmental PACS. Upon completing the tasks, the Computer System Usability Questionnaire (CSUQ) was administered to assess their satisfaction with the system. Results from data analysis showed that nursing students who completed the evaluation had a satisfactory experience with the system. The Information Quality subscale mean was the highest mean of the CSUQ subscales. This is an important finding as the multidisciplinary data visualization feature of the system provides a technology-enhanced learning environment that can support nursing students’ efforts to both organize and represent knowledge. Through the compartmental PACS, students are assisted in connecting relevant knowledge via various representations of medical data for the clinical conditions under study.     

Advancing young adolescents’ hypothesis-development performance in a computer-supported and problem-based learning environment

Hypothesis development is a complex cognitive activity, but one that is critical as a means of reducing uncertainty during ill-structured problem solving. In this study, we examined the effect of metacognitive scaffolds in strengthening hypothesis development. We also examined the influence of hypothesis development on young adolescents’ problem-solving performance. Data was collected from sixth-grade students (N = 172) using a computer-supported problem-based learning environment, Animal Investigator. The findings of the study indicated that participants using metacognitive scaffolds developed significantly better hypotheses and that hypothesis-development performance was predictive of solution-development performance. This article discusses further educational implications of the findings and future research.     

Design and usability testing of a learning and plagiarism avoidance tutorial system for paraphrasing and citing in English: A case study

The prevalence of information and communication technology (ICT) has considerably converted the means of/for publication and circulation, as well as transforming academia and English pedagogy. However, with the availability and convenience of online resources, one of the critical issues emerged is that non-native English speakers are constantly accused of committing textual plagiarism: either intentionally or unintentionally. While many writing tools and plagiarism detectors are available to help solve the problem, none of them were customized for the great population of Chinese learners of English. Accordingly, DWright—a Chinese-interfaced online writing tutorial for paraphrasing and citing English—was developed in the hope of ensuring academic integrity through the avoidance of textual plagiarism.The purpose of this study was to evaluate the design and efficacy of DWright regarding plagiarism prevention and improvement of English writing. A questionnaire and semi-structured interview were administrated to participants to test DWright and its technology acceptance model (TAM) to identify the effect of perceived usefulness, usability and user attitudes of DWright. Results show that users of DWright were in high agreement regarding the content effectiveness of all DWright-based tasks, indicating the reading activities, multiple-choice exercises and paraphrasing practices were effective to help users enhance writing knowledge and skills to avoid plagiarism. Furthermore, perceived usefulness and system usability affected DWright user attitudes significantly and positively, which mirrors their attitudes toward continued use of DWright. In this study, DWright met its users' needs by extending their knowledge to avoid plagiarism while simultaneously enhancing their paraphrasing and writing skills. The conclusion suggests that tutorial designers, content experts and subject teachers should support effective communication to improve content usefulness, so as to help users achieve their writing goals with a research proven learning and plagiarism avoidance tutorial system.     

How to improve the peer review method: Free-selection vs assigned-pair protocol evaluated in a computer networking course

This study provides field research evidence on the efficiency of a “free-selection” peer review assignment protocol as compared to the typically implemented “assigned-pair” protocol. The study employed 54 sophomore students who were randomly assigned into three groups: Assigned-Pair (AP) (the teacher assigns student works for review to student pairs), Free-Selection (FS) (students are allowed to freely explore and select peer work for review), and No Review (NR) (control group). AP and FS student groups studied and reviewed peer work in the domain of Computer Networking, supported by a web-based environment designed to facilitate the two peer review protocols. Our results indicate that students following the Free Selection protocol demonstrate (a) better domain learning outcomes, and (b) better reviewer skills, compared to the AP condition. Overall, the study analyzes the benefits and shortcomings of the FS vs AP review assignment protocol, providing evidence that the FS condition can be multiply beneficial to students who engage in peer review activities.     

Invisible success: Problems with the grand technological innovation in higher education

This paper investigates a ‘grand’ educational technology innovation through theoretical lenses inspired by 10 and 11 work. Through taking this approach it is possible to show how ideas about the form of the innovation and perceptions of its ultimate ‘success’ or ‘failure’, varied between stakeholder groups. The project was pedagogically effective and popular with students, but was difficult to ‘sell’ to academics, had no senior management sponsor, and was unable to bring about cultural change in the institution despite the capital funding designed to do just that. Although many pedagogical lessons were learned, and have since been applied in other learning spaces around the host campus and elsewhere, these successful disseminations of changed practice were not in accordance with the objectives of key stakeholders. Therefore, they went unconsidered when decisions were taken about the project’s sustainability: hence the notion of ‘invisible success’. The project’s ‘failure’ is only apparent when viewed from certain perspectives; nevertheless, these perspectives are those of the powerful (or in 8 and 9 terms, those possessing capital and academic power) and are the consequence of deeply-rooted structural features in HE, which include funding models, risk-averseness, and fragmented responsibilities.     

Researching haptics in higher education: The complexity of developing haptics virtual learning systems and evaluating its impact on students’ learning

hapTEL, an interdisciplinary project funded by two UK research councils from 2007 to 2011, involves a large interdisciplinary team (with undergraduate and post-graduate student participants) which has been developing and evaluating a virtual learning system within an HE healthcare education setting, working on three overlapping strands. Strand 1 involves the technical development and evaluation of the hapTEL workstation which simulates clinical conditions for dental training including haptics (sense of touch). Strand 2 involves examining the traditional undergraduate curriculum and how this could benefit from the use of haptics. Strand 3 is concerned with the educational evaluation of the impact of the work carried out within Strands 1 and 2. Two theoretical frameworks (Entwistle, (1987) and Webb and Cox (2004)) have been used to identify as many factors as possible which could affect the impact of Technology Enhanced Learning (TEL) on the quality of the learning achieved. These frameworks have formed a foundation for measuring the impact of TEL on curriculum change, teachers’ pedagogical practices, students’ learning and on institutional practices. A range of quantitative and qualitative methods were designed, piloted and evaluated in order to measure the impact of TEL on teaching and learning; and to have a rich and robust data set which also addresses the variables in the frameworks. The results from using these frameworks show that institutional and departmental factors should be considered when evaluating the impact of TEL in higher education and that these had a major influence on the design and curriculum integration of the hapTEL systems. We have also shown that by involving the end users from the beginning enabled not only an enhancement of the students’ learning experiences but also a modification to the traditional curriculum itself and the successful integration of TEL within a very traditional undergraduate higher education dental curriculum. The conclusions from this paper confirm earlier reviews of researching TEL that technology integration is extremely complex and the related research requires a comprehensive approach of both quantitative and qualitative methods if one is to take account of the range of variables identified by theoretical frameworks. Finally, repeating the range of empirical investigations for a second year enables researchers to validate the effectiveness of the methods used in the initial year and thereby maximise the reliability and generalisability of the research outcomes.     

Exploring differences between gifted and grade-level students’ use of self-regulatory learning processes with hypermedia

Research involving gifted and grade-level students has shown that they display differences in their knowledge of self-regulatory strategies. However, little research exists regarding whether these students differ in their actual use of these strategies. This study aimed to address this question by examining think-aloud data collected from 98 gifted and grade-level students engaging in a complex learning task: utilizing a hypermedia environment to learn about the circulatory system. We also examined both declarative knowledge and mental model measures of learning to determine whether these groups differed in their actual performance. Our results show that gifted students did outperform grade-level students in all outcome measures. In addition, gifted students more often utilized more sophisticated self-regulatory strategies (e.g. coordinating informational sources) than grade-level students. Grade-level students were more likely to use less effective strategies that are less likely to promote the acquisition of knowledge (e.g. mnemonics). Recommendations for future intervention studies are based upon these findings.     

Exploring relations among college students’ prior knowledge,implicit theories of intelligence,and self-regulated learning in a hypermedia environment

Researchers and educators continue to explore how to assist students in the acquisition of conceptual understanding of complex science topics. While hypermedia learning environments (HLEs) afford unique opportunities to display multiple representations of these often abstract topics, students who do not engage in self-regulated learning (SRL) with HLEs often fail to achieve conceptual understanding. There is a lack of research regarding how student characteristics, such as prior knowledge and students’ implicit theory of intelligence (ITI), interact with SRL to influence academic performance. In this study, structural equation modeling was used to investigate these issues. It was found that prior knowledge and ITI were related to SRL and performance, and that SRL acted as a benevolent moderator, enhancing the positive effects of prior knowledge upon learning, and diminishing the negative effects of having a maladaptive ITI.     

An auto-scoring mechanism for evaluating problem-solving ability in a web-based learning environment

The rapid development of computer and network technologies has attracted researchers to investigate strategies for and the effects of applying information technologies in learning activities; simultaneously, learning environments have been developed to record the learning portfolios of students seeking web information for problem-solving. Although previous research has demonstrated the benefits of applying information technologies to learning activities, the difficulties in doing so have also been revealed. One of the major difficulties is the lack of a mechanism to assist teachers in evaluating the problem-solving ability of the students, such that constructive suggestions can be given to the students, and tutoring strategies can be improved accordingly.     

Effects of multidimensional concept maps on fourth graders’ learning in web-based computer course

This study explores the effect of multidimensional concept mapping instruction on students’ learning performance in a web-based computer course. The subjects consisted of 103 fourth graders from an elementary school in central Taiwan. They were divided into three groups: multidimensional concept map (MCM) instruction group, Novak concept map (NCM) instruction group, and traditional textbook (TT) instruction group. Four weeks of experimental instructions were given to the three groups, respectively. Students’ progresses were examined by pre-test and post-test measurements. The experimental results suggested that subjects in the MCM group performed significantly better than those in the NCM group which in turn performed significantly better than those in the TT group. Pedagogical implications were addressed, and conclusion and some suggestions were given.     

The effect of scaffolding students’ context-generating cognitive activity in technology-enhanced case-based learning

This study investigates the hypothesis that students’ learning and problem-solving performance in ill-structured domains can be improved, if elaborative question prompts are used to activate students’ context-generating cognitive processes, during case study. Two groups of students used a web-based learning environment to criss-cross and study case-based material in the software project management domain. The experimental group was additionally prompted to consistently answer a set of questions based on a model of context-generating processes, meant to engage students in deeper processing of information presented in cases. Students were also classified as having either “complex” or “simple” EB profile (based on their epistemological beliefs record), thereby establishing a 2 × 2 factorial design. Results indicated that scaffolding treatment had a significant main effect on students’ performance, with the experimental group performing better in both domain knowledge acquisition and knowledge transfer post-test items. There is also tentative indication that EB profile and scaffolding treatment interact, with complex-EB learners benefiting most from the scaffolded condition. Overall, the study provides evidence that it is possible to improve individual learning in a technology environment for case-based learning, by implementing appropriate questioning strategies that trigger students to activate their context-generating cognitive processes, while studying the contextually rich material of cases.     

Effects on learning of multimedia animation combined with multidimensional concept maps

This study investigates whether teaching materials combining multimedia animation and multidimensional concept maps (MAMCMs) improve learning achievement, retention, and satisfaction more than multidimensional concept maps (MCMs), as suggested by Huang et al. (2012) in Computers & Education. Learning retention, learning achievement, and learning satisfaction associated with two sets of course materials were compared in this quasi-experimental study. In total, 114 students from two classes at one private university in Taiwan participated in this 6-week teaching experiment. Analytical results indicate that learning achievement, learning satisfaction, and learning retention of the MAMCM group were better than those of the MCM group. Pedagogical implications and suggestions are given.     

The effect of multiple scaffolding tools on students’ understanding,consideration of different perspectives,and misconceptions of a complex problem

This study investigated the effectiveness of multiple scaffolding tools in helping students understand a complex problem. In order to support students with this task, a multimedia learning environment was developed based on the cognitive flexibility theory (CFT) and scaffolding through computer-based tools. Seventy-nine 10th-grade students in an urban high school participated in this study. A quasi-experimental method was used to compare the effectiveness of different scaffolding tools within this learning environment. Scaffolding used in conjunction with CFT principles did not affect students’ ability to consider multiple perspectives or their numbers of misconceptions. On the other hand, scaffolding tools had varying effects on students’ problem understanding, and a significant interaction was found between the different scaffolding tools used. This study raised questions about the effectiveness of combining multiple scaffolding tools within a multimedia environment.     

The effects of UZWEBMAT on the probability unit achievement of Turkish eleventh grade students and the reasons for such effects

This study aimed at determining the effects of UZWEBMAT (Turkish abbreviation of Adaptive and INtelligent WEB based MAThematics teaching–learning system) on the probability unit academic achievement of students and the underlying reasons for these effects. The study was conducted in an Anatolian High School located in a district of Trabzon province, Turkey in the fall semester of the academic year 2011–2012. The research sample consisted of 106 eleventh grade students and 2 mathematics teachers. Semi-experimental method was used in the study. Pre-Probability Unit Achievement Test (pre-PUAT), Post-Probability Unit Achievement Test (post-PUAT), Scale for Evaluation of the UZWEBMAT by Students (SEUS), Student Interview Form (SIF), and Teacher Interview Form (TIF) were used for collecting data. Research results indicated that there was a statistically significant difference in favor of the experimental group (EG) students between the academic achievement of the EG students and that of the control group (CG) students. In addition, male EG students were found to be more successful than female EG students. However, no statistically significant relationship was found between the learning styles and the academic achievements of the EG students with different learning styles (visual–auditory–kinesthetic). In addition, no statistically significant relationship was detected between the genders and the academic achievements of the EG students having different learning styles. It was concluded that the higher achievement of the EG students resulted from the fact that they received education in accordance with their learning styles via UZWEBMAT, the learning objects included in UZWEBMAT had appropriate structural characteristics, students enjoyed learning in that environment, and students had continuous interest in the lesson.     

Towards new forms of knowledge communication: the adaptive dimension of a web-based learning environment

Adaptive Educational Hypermedia Systems aim to increase the functionality of hypermedia by making it personalised to individual learners. The adaptive dimension of these systems mainly supports knowledge communication between the system and the learner by adapting the content or the appearance of hypermedia to the knowledge level, goals and other characteristics of each learner. The main objectives are to protect learners from cognitive overload and disorientation by supporting them to find the most relevant content and path in the hyperspace. In the approach presented in this paper, learners' knowledge level and individual traits are used as valuable information to represent learners' current state and personalise the educational system accordingly, in order to facilitate learners to achieve their personal learning goals and objectives. Learners' knowledge level is approached through a qualitative model of the level of performance that learners exhibit with respect to the concepts they study and is used to adapt the lesson contents and the navigation support. Learners' individual traits and especially their learning style represent the way learners perceive and process information, and are exploited to adapt the presentation of the educational material of a lesson. The proposed approach has been implemented through various adaptation technologies and incorporated into a prototype hypermedia system. Finally, a pilot study has been conducted to investigate system's educational effectiveness.     

Students’ perceptions of teaching technologies, application of technologies, and academic performance

This study examined business students’ perceptions of four objectives (i.e., Enjoyment, Learning, Motivation, and Career Application) across five teaching technologies (i.e., Projector, PowerPoint, Video, the Internet, and Lecture), business professors’ effective application of technologies, and students’ academic performance. We collected data from 215 students at a regional state university in the USA. We developed Students’ Perceptions of Technology Scale, SPOTS, specifically for the present study, used the most rigorous criteria, and investigated reliability, convergent and discriminant validity, exploratory and confirmatory factor analysis, and measurement invariance of this scale. Mean scores revealed that Video conveyed the highest amount of Enjoyment. PowerPoint provided the highest amount of Learning and Motivation. The Internet provided the highest Career Application for future jobs. Younger students preferred Video, whereas older students favored Lecture. Regression results showed that the use of Video for Learning, Projector and Lecture for Enjoyment, PowerPoint for career and Motivation, and the Internet for Learning contributed to professors’ teaching effectiveness. Students’ high ratings for professors’ effective use of the Lecture method and low expectation for the use of a Projector predicted their self-reported GPA (academic performance). Professors may use a different mix of technologies in the classroom and use them creatively in order to promote the most Learning for students and satisfy students’ Learning needs and objectives.     

An adaptation algorithm for an intelligent natural language tutoring system

The focus of computerised learning has shifted from content delivery towards personalised online learning with Intelligent Tutoring Systems (ITS). Oscar Conversational ITS (CITS) is a sophisticated ITS that uses a natural language interface to enable learners to construct their own knowledge through discussion. Oscar CITS aims to mimic a human tutor by dynamically detecting and adapting to an individual's learning styles whilst directing the conversational tutorial. Oscar CITS is currently live and being successfully used to support learning by university students. The major contribution of this paper is the development of the novel Oscar CITS adaptation algorithm and its application to the Felder–Silverman learning styles model. The generic Oscar CITS adaptation algorithm uniquely combines the strength of an individual's learning style preference with the available adaptive tutoring material for each tutorial question to decide the best fitting adaptation. A case study is described, where Oscar CITS is implemented to deliver an adaptive SQL tutorial. Two experiments are reported which empirically test the Oscar CITS adaptation algorithm with students in a real teaching/learning environment. The results show that learners experiencing a conversational tutorial personalised to their learning styles performed significantly better during the tutorial than those with an unmatched tutorial.     

Effects of feedback in a computer-based assessment for learning

The effects of written feedback in a computer-based assessment for learning on students’ learning outcomes were investigated in an experiment at a Higher Education institute in the Netherlands. Students were randomly assigned to three groups, and were subjected to an assessment for learning with different kinds of feedback. These are immediate knowledge of correct response (KCR) + elaborated feedback (EF), delayed KCR + EF, and delayed knowledge of results (KR). A summative assessment was used as a post-test. No significant effect was found for the feedback condition on student achievement on the post-test. Results suggest that students paid more attention to immediate than to delayed feedback. Furthermore, the time spent reading feedback was positively influenced by students’ attitude and motivation. Students perceived immediate KCR + EF feedback to be more useful for learning than KR. Students also had a more positive attitude towards feedback in a CBA when they received KCR + EF rather than KR only.