I-Quiz: An Intelligent Assessment Tool for Non-Verbal Behaviour Detection

Electronic learning (e-learning) has become one of the widely used modes of pedagogy in higher education today due to the convenience and flexibility offered in comparison to traditional learning activities. Advancements in Information and Communication Technology have eased learner connectivity online and enabled access to an extensive range of learning materials on the World Wide Web. Post covid-19 pandemic, online learning has become the most essential and inevitable medium of learning in primary, secondary and higher education. In recent times, Massive Open Online Courses (MOOCs) have transformed the current education strategy by offering a technology-rich and flexible form of online learning. A key component to assess the learner’s progress and effectiveness of online teaching is the Multiple Choice Question (MCQ) assessment in most of the MOOC courses. Uncertainty exists on the reliability and validity of the assessment component as it raises a qualm whether the real knowledge acquisition level reflects upon the assessment score. This is due to the possibility of random and smart guesses, learners can attempt, as MCQ assessments are more vulnerable than essay type assessments. This paper presents the architecture, development, evaluation of the I-Quiz system, an intelligent assessment tool, which captures and analyses both the implicit and explicit non-verbal behaviour of learner and provides insights about the learner’s real knowledge acquisition level. The I-Quiz system uses an innovative way to analyse the learner non-verbal behaviour and trains the agent using machine learning techniques. The intelligent agent in the system evaluates and predicts the real knowledge acquisition level of learners. A total of 500 undergraduate engineering students were asked to attend an on-Screen MCQ assessment test using the I-Quiz system comprising 20 multiple choice questions related to advanced C programming. The non-verbal behaviour of the learner is recorded using a front-facing camera during the entire assessment period. The resultant dataset of non-verbal behaviour and question-answer scores is used to train the random forest classifier model to predict the real knowledge acquisition level of the learner. The trained model after hyperparameter tuning and cross validation achieved a normalized prediction accuracy of 85.68%.     

Design and development of an innovative individualized adaptive and intelligent e-learning system for teaching–learning of probability unit: Details of UZWEBMAT

In this study, an innovative adaptive and intelligent web based e-learning system, UZWEBMAT (Turkish abbreviation of Adaptive and INtelligent WEB based MAThematics teaching–learning system) was designed, developed and implemented. This e-learning system was intended for learning and teaching secondary school level permutation-combination-binomial expansion and probability subjects. Content which was prepared according to Turkish curriculum for secondary school mathematics course was transformed into learning objects in three different ways in accordance with VAK (Visual–Auditory–Kinesthetic) learning styles. Primary/secondary/tertiary learning styles of learners registering the system are determined and each learner receives the content appropriate for his/her dominant learning style. Also, they can be directed to contents of other styles according to their performances thanks to an expert system. Learning objects constituting the content were prepared according to constructivist approach. An active role for the learner was the purpose. Tips and intelligent solution supports within the learning objects were presented with expert system support to the learners. With this structure, UZWEBMAT bears the characteristics of intelligent tutoring system as well as an adaptive e-learning environment. All the movements of learners studying with UZWEBMAT are recorded and the necessary information is reported to both learners and teachers in a visualized way.     

Personalized web-based tutoring system based on fuzzy item response theory

With the rapid growth of computer and Internet technologies, e-learning has become a major trend in the computer assisted teaching and learning field. Previously, many researchers put effort into e-learning systems with personalized learning mechanism to aid on-line learning. However, most systems focus on using learner’s behaviors, interests, and habits to provide personalized e-learning services. These systems commonly neglect to consider if learner ability and the difficulty level of the recommended courseware are matched to each other. Frequently, unsuitable courseware causes learner’s cognitive overload or disorientation during learning. To promote learning effectiveness, our previous study proposed a personalized e-learning system based on Item response theory (PEL-IRT), which can consider both course material difficulty and learner ability evaluated by learner’s crisp feedback responses (i.e. completely understanding or not understanding answer) to provide personalized learning paths for individual learners. The PEL-IRT cannot estimate learner ability for personalized learning services according to learner’s non-crisp responses (i.e. uncertain/fuzzy responses). The main problem is that learner’s response is not usually belonging to completely understanding or not understanding case for the content of learned courseware. Therefore, this study developed a personalized intelligent tutoring system based on the proposed fuzzy item response theory (FIRT), which could be capable of recommending courseware with suitable difficulty levels for learners according to learner’s uncertain/fuzzy feedback responses. The proposed FIRT can correctly estimate learner ability via the fuzzy inference mechanism and revise estimating function of learner ability while the learner responds to the difficulty level and comprehension percentage for the learned courseware. Moreover, a courseware modeling process developed in this study is based on a statistical technique to establish the difficulty parameters of courseware for the proposed personalized intelligent tutoring system. Experiment results indicate that applying the proposed FIRT to web-based learning can provide better learning services for individual learners than our previous study, thus helping learners to learn more effectively.     

A web-based e-learning system for increasing study efficiency by stimulating learner’s motivation

Due to the opportunities provided by the Internet, more and more people are taking advantage of distance learning courses and during the last few years enormous research efforts have been dedicated to the development of distance learning systems. So far, many e-learning systems are proposed and used practically. However, in these systems the e-learning completion rate is about 30%. One of the reasons is the low study desire when the learner studies the learning materials. In this research, we propose an interactive Web-based e-learning system. The purpose of our system is to increase the e-learning completion rate by stimulating learner’s motivation. The proposed system has three subsystems: the learning subsystem, learner support subsystem, and teacher support subsystem. The learning subsystem improves the learner’s study desire. The learner support subsystem supports the learner during the study, and the teacher support subsystem supports the teacher to get the learner’s study state. To evaluate the proposed system, we developed several experiments and surveys. By using new features such as: display of learner’s study history, change of interface color, encourage function, ranking function, self-determination of the study materials, and grouping of learners, the proposed system can increase the learning efficiency.

面向智能教育的自适应学习关键技术与应用

本文是关于我们获得2020年度吴文俊人工智能科学技术奖主要工作的一个介绍。该成果针对自适应学习中面临的教学资源表示困难、学习状态诊断困难以及学习策略设计困难等关键技术难题,首先构建数据驱动的教学资源无监督表示新框架,提高了教学资源质量评估和内容检索的精度和效率。其次提出基于深度学习的学习者认知诊断新方法,突破了以量表为基础的教育测量理论研究范式。然后设计基于知识匹配的个性化推荐技术以及多目标匹配的自适应推荐技术,满足了智能教育场景的复杂约束与学习者的多样目标需求。最后,本文成果研发了面向基础教育的智能教育系统——智学网,已在全国推广使用,对我国智能教育发展具有积极意义。     

eTeacher: Providing personalized assistance to e-learning students

In this paper we present eTeacher, an intelligent agent that provides personalized assistance to e-learning students. eTeacher observes a student’s behavior while he/she is taking online courses and automatically builds the student’s profile. This profile comprises the student’s learning style and information about the student’s performance, such as exercises done, topics studied, exam results. In our approach, a student’s learning style is automatically detected from the student’s actions in an e-learning system using Bayesian networks. Then, eTeacher uses the information contained in the student profile to proactively assist the student by suggesting him/her personalized courses of action that will help him/her during the learning process. eTeacher has been evaluated when assisting System Engineering students and the results obtained thus far are promising.     

Performance evaluation of an online argumentation learning assistance agent

Recent research indicated that students’ ability to construct evidence-based explanations in classrooms through scientific inquiry is critical to successful science education. Structured argumentation support environments have been built and used in scientific discourse in the literature. To the best of our knowledge, no research work in the literature addressed the issue of automatically assessing the student’s argumentation quality, and the teaching load of the teacher that used the online argumentation support environments is not alleviated. In this work, an intelligent argumentation assessment system based on machine learning techniques for computer supported cooperative learning is proposed. Learners’ arguments on discussion board were examined by using argumentation element sequence to detect whether the learners address the expected discussion issues and to determine the argumentation skill level achieved by the learner. Learners are first assigned to heterogeneous groups based on their responses to the learning styles questionnaire given right before the beginning of learning activities on the e-learning platform. A feedback rule construction mechanism is used to issue feedback messages to the learners in case the argumentation assessment system detects that the learners go in a biased direction. The Moodle, an open source software e-learning platform, was used to establish the cooperative learning environment for this study. The experimental results exhibit that the proposed work is effective in classifying and improving student’s argumentation level and assisting the students in learning the core concepts taught at a natural science course on the elementary school level.     

Integrating learning styles and adaptive e-learning system: Current developments,problems and opportunities

Learning styles which refer to students’ preferred ways to learn can play an important role in adaptive e-learning systems. With the knowledge of different styles, the system can offer valuable advice and instructions to students and teachers to optimise students’ learning process. Moreover, e-leaning system which allows computerised and statistical algorithms opens the opportunity to overcome drawbacks of the traditional detection method that uses mainly questionnaire. These appealing reasons have led to a growing number of researches looking into the integration of learning styles and adaptive learning system. This paper, by reviewing 51 studies, delves deeply into different parts of the integration process. It captures a variety of aspects from learning styles theories selection in e-learning environment, online learning styles predictors, automatic learning styles classification to numerous learning styles applications. The results offer insights into different developments, achievements and open problems in the field. Based on these findings, the paper also provides discussion, recommendations and guidelines for future researches.     

Automatic detection of learning styles for an e-learning system

A desirable characteristic for an e-learning system is to provide the learner the most appropriate information based on his requirements and preferences. This can be achieved by capturing and utilizing the learner model. Learner models can be extracted based on personality factors like learning styles, behavioral factors like user’s browsing history and knowledge factors like user’s prior knowledge. In this paper, we address the problem of extracting the learner model based on Felder–Silverman learning style model. The target learners in this problem are the ones studying basic science. Using NBTree classification algorithm in conjunction with Binary Relevance classifier, the learners are classified based on their interests. Then, learners’ learning styles are detected using these classification results. Experimental results are also conducted to evaluate the performance of the proposed automated learner modeling approach. The results show that the match ratio between the obtained learner’s learning style using the proposed learner model and those obtained by the questionnaires traditionally used for learning style assessment is consistent for most of the dimensions of Felder–Silverman learning style.     

Personalizing the Interaction in a Web-based Educational Hypermedia System: the case of INSPIRE

In this paper we present an Adaptive Educational Hypermedia prototype, named INSPIRE. The approach employed in INSPIRE emphasizes the fact that learners perceive and process information in very different ways, and integrates ideas from theories of instructional design and learning styles. Our aim is to make a shift towards a more 'learning-focused' paradigm of instruction by providing a sequence of authentic and meaningful tasks that matches learner' preferred way of studying. INSPIRE, throughout its interaction with the learner, dynamically generates learner-tailored lessons that gradually lead to the accomplishment of learner's learning goals. It supports several levels of adaptation: from full system-control to full learner-control, and offers learners the option to decide on the level of adaptation of the system by intervening in different stages of the lesson generation process and formulating the lesson contents and presentation. Both the adaptive and adaptable behavior of INSPIRE are guided by the learner model which provides information about the learner, such as knowledge level on the domain concepts and learning style. The learner model is exploited in multiple ways: curriculum sequencing, adaptive navigation support, adaptive presentation, and supports system's adaptable behavior. An empirical study has been performed to evaluate the adaptation framework and assess learners' attitudes towards the proposed instructional design.     

Provision of awareness of learners’ emotions through visualizations in a computer interaction-based environment

One of the challenges of intelligent systems for education is to use low-level data collected in computer environments in the form of events or interactions to infer information with high-level significance using artificial intelligence techniques, and present it through visualizations in a meaningful and effective way. Among this information, emotional data is gaining track in by instructors in their educational activities. Many benefits can be obtained if an intelligent systems can bring teachers with knowledge about their learner’s emotions, learning causes, and learning relationships with emotions. In this paper, we propose and justify a set of visualizations for an intelligent system to provide awareness about the emotions of the learners to the instructor based on the learners’ interactions in their computers. We apply these learner’s affective visualizations in a programming course at University level with more than 300 students, and analyze and interpret the student’s emotional results in connection with the learning process.     

Effects of social-interactive engagement on the dropout ratio in online learning: insights from MOOC

In online learning, the high dropout ratio is a serious problem and reflects a poor level of motivation in e-learning programmes. Social-interactive engagement may greatly affect users’ attitudes and choices in many fields; among these, online learning is inevitably impacted by factors such as social connections. To study the impact of social-interactive engagement on the dropout ratio and learning progress, iMOOC was employed as the study object using data from 619 courses and 2,071,147 learners, as well as 19,451,428 learning records. As engagement is a process of collecting experiences, the learner’s experience plays a significant role in reducing the dropout ratio. Social-interactive engagement helps to reduce the dropout ratio; thus, learners should be encouraged to engage in online activities, such as discussions, note sharing, commenting and Q&A, to alleviate the feelings of being disconnected and isolated. Through an empirical study, we also find that the longer a learner's registered time is, the lower the dropout ratio. From the perspective of the courses themselves, the dropout ratios of shorter or more difficult courses are lower than those of longer or less-difficult courses. This paper provides theoretical and practical recommendations for reducing the dropout ratio in online learning and improving learning efficiency.     

Virtual reality for collaborative e-learning

In the past, the term e-learning referred to any method of learning that used electronic delivery methods. With the advent of the Internet however, e-learning has evolved and the term is now most commonly used to refer to online courses. A multitude of systems are now available to manage and deliver learning content online. While these have proved popular, they are often single-user learning environments which provide little in the way of interaction or stimulation for the student. As the concept of lifelong learning now becomes a reality and thus more and more people are partaking in online courses, researchers are constantly exploring innovative techniques to motivate online students and enhance the e-learning experience. This article presents our research in this area and the resulting development of CLEV-R, a Collaborative Learning Environment with Virtual Reality. This web-based system uses Virtual Reality (VR) and multimedia and provides communication tools to support collaboration among students. In this article, we describe the features of CLEV-R, its adaptation for mobile devices and present the findings from an initial evaluation.     

A learning style classification mechanism for e-learning

With the growing demand in e-learning, numerous research works have been done to enhance teaching quality in e-learning environments. Among these studies, researchers have indicated that adaptive learning is a critical requirement for promoting the learning performance of students. Adaptive learning provides adaptive learning materials, learning strategies and/or courses according to a student’s learning style. Hence, the first step for achieving adaptive learning environments is to identify students’ learning styles. This paper proposes a learning style classification mechanism to classify and then identify students’ learning styles. The proposed mechanism improves k-nearest neighbor (k-NN) classification and combines it with genetic algorithms (GA). To demonstrate the viability of the proposed mechanism, the proposed mechanism is implemented on an open-learning management system. The learning behavioral features of 117 elementary school students are collected and then classified by the proposed mechanism. The experimental results indicate that the proposed classification mechanism can effectively classify and identify students’ learning styles.     

Towards online reinforced learning of assembly sequence planning with interactive guidance systems for industry 4.0 adaptive manufacturing

Literature shows that reinforcement learning (RL) and the well-known optimization algorithms derived from it have been applied to assembly sequence planning (ASP); however, the way this is done, as an offline process, ends up generating optimization methods that are not exploiting the full potential of RL. Today’s assembly lines need to be adaptive to changes, resilient to errors and attentive to the operators’ skills and needs. If all of these aspects need to evolve towards a new paradigm, called Industry 4.0, the way RL is applied to ASP needs to change as well: the RL phase has to be part of the assembly execution phase and be optimized with time and several repetitions of the process. This article presents an agile exploratory experiment in ASP to prove the effectiveness of RL techniques to execute ASP as an adaptive, online and experience-driven optimization process, directly at assembly time. The human-assembly interaction is modelled through the input-outputs of an assembly guidance system built as an assembly digital twin. Experimental assemblies are executed without pre-established assembly sequence plans and adapted to the operators’ needs. The experiments show that precedence and transition matrices for an assembly can be generated from the statistical knowledge of several different assembly executions. When the frequency of a given subassembly reinforces its importance, statistical results obtained from the experiments prove that online RL applications are not only possible but also effective for learning, teaching, executing and improving assembly tasks at the same time. This article paves the way towards the application of online RL algorithms to ASP.     

Developing argumentation processing agents for computer-supported collaborative learning

In this study, an intelligent argumentation processing agent for computer-supported cooperative learning is proposed. Learners are first assigned to heterogeneous groups based on their learning styles questionnaire given right before the beginning of learning activities on the e-learning platform. The proposed argumentation processing agent then scrutinizes each learner’s learning portfolio on e-learning platform and automatically issues feedback messages in case devious argument or abnormal behavior that is unfitted to the learners’ learning style is detected. The Moodle (http://moodle.org), an open source software e-learning platform, is used to establish the cooperative learning environment for this study. The experimental results revealed that the learners benefited by the argumentation activity with the assistance of the proposed learning style aware argumentation processing agent.     

基于自组织社区发现的协作学习算法

远程学习者通常很难判断哪些学习资源最适合他们的阅读需要,同时对教师来说,针对每个学习者重新组织不同的学习资源几乎是不可能的。基于此,提出一种新颖的学习偏好建模方法,通过将动态学习数据映射为“资源、评估”的方式实现对学习特征的综合评估;通过构建智能代理来监控学习者的动态学习行为;提出组隶属度奖励机制和组成员交换机制,实现对分布式环境下的相似学习者的社区自组织;同时,基于JADE智能代理平台开发了一个协作学习平台,使得具有相似学习偏好的学习者能够进行学习资源和经验的共享。实验证明,算法具有较高的匹配准确性和社区构建效率,并能够切实提高协作学习的有效性。     

A comprehensive adaptive system for e-learning of foreign languages

The article presents a proposal, design and implementation of a new approach to adaptive e-learning systems. First, a proposal of a model is presented. This model aims at introducing adaptivity to current e-learning systems, which are rigid and limited in offering a truly personalised learning to individual students. Many of current e-learning systems enable personalised learning. However, in this paper, there is a new, innovative approach proposed for an adaptive personalised e-learning system. The primary area of our research is English as a second language (ESL). Adaptivity in our view is considered as an ability of the system to adapt to student's knowledge and characteristics. This pedagogical perspective requires introduction of such processes that enable to work the pedagogical aspects of teaching/learning. The required processes are of informatics nature. The proposed model was subsequently designed into a real application. Finally, the application was implemented and verified on a real data set. The results are also provided.     

Assessing e-learning 2.0 system success

Traditional e-learning systems support “one-way” communication. Teachers provide knowledge for learners, but they are unable to use a student’s learning experiences to benefit the class as a whole. To address these problems, this study explores e-learning success factors via the design and evaluation of an e-learning 2.0 system. This study develops a theoretical model to assess user satisfaction and loyalty intentions to an e-learning system using communication quality, information quality, system quality, and service quality. The empirical results show that communication quality, information quality, and service quality significantly and positively affect user satisfaction and loyalty intentions to use the e-learning system for sharing experience, communicating with others, and getting feedback.