Outcomes for design and learning when teenagers with autism codesign a serious game: A pilot study

Digital educational games research tends to lack ecological validity by not adequately taking into account the views and perspectives of children and young people with autism spectrum disorders (ASD). This paper is a pilot study that explores and analyses an academic‐based educational game that was co‐designed with and for young people with ASD. The serious game aims to help the players learn Geography‐specific knowledge and integrates several strategic features so that users can collaborate together against the computer or compete against each other. The educational game was evaluated over 5 sessions by 3 peer teams from 2 different special educational institutions, involving a total of 6 students with ASD. The participants were positive about their enjoyment, motivation, and social engagement. The results showed that the players' level of competitiveness not only influenced the experience within the game but also the interaction within the peer teams. The game mechanisms did help the participants with ASD increase their knowledge in Geography content. The main conclusion is that there are considerable benefits of including children with ASD in the design process and future research should explore more fully on how their involvement can enhance curriculum‐based learning as well as social engagement within the classroom.     

An inclusive design approach for developing video games for children with Autism Spectrum Disorder

The efficacy of therapeutic treatments for Autism Spectrum Disorder is mainly associated with the treatment's intensity in terms of weekly hours. This has led mental health professionals to explore the use of video games to complement traditional treatments. However, major weaknesses have been found due to poor game design, which has failed to fulfill therapeutic objectives or to properly engage children. These weaknesses are typically characterized by the poor integration of knowledge from mental health experts, children's interests and designers' expertise. Starting from this necessity, we propose an inclusive design approach to develop therapeutic games. The method presents strategies to integrate the expertise of clinicians, contributions of children and experience of designers through a set of elicitation and merging techniques. The goal of this method is to design games that are effective in terms of therapeutic objectives and that are enjoyable for children. To describe this method, we present its application in the design and development of a Kinect-based game for high-functioning children with ASD called “Pico's Adventures”. This game aims at promoting social initiation in young children with autism. Findings from a first exploratory study with 10 children with ASD showed the effectiveness of the game in eliciting social initiation behaviors. This provides a first validation of the method. An essential aspect of the game's success was the use of elements and mechanics that were appealing for the children. As a result, we have identified effective design concepts and paths for further research on games for children with ASD.     

Audio-augmented paper for therapy and educational intervention for children with autistic spectrum disorder

Autism affects children׳s learning and social development. Commonly used rehabilitative treatments are aimed at stimulating the social skills of children with autism. In this article, we present a prototype and a pilot study on an audio-augmented paper to support the therapy of children with autism spectrum disorder (ASD). The prototype supports audio recording with standard sheets of paper by using tangible tools that can be shared between the therapist and the child. The prototype is a tool for the therapist to engage the child in a storytelling activity. We use a progressive design method based on a dynamic process that merges concept generation, technology benchmarking and activity design into continuously enriching actions. The paper highlights the qualities and benefits of using tangible audio-augmented artefacts for therapy and educational intervention for children with ASD. The work describes three main qualities of our prototype: from building cooperation to attention control, flow control, and using the children׳s own voices to foster attention.     

Serious games for higher education: a framework for reducing design complexity

Abstract Serious games open up many new opportunities for complex skills learning in higher education. The inherent complexity of such games, though, requires large efforts for their development. This paper presents a framework for serious game design, which aims to reduce the design complexity at conceptual, technical and practical levels. The approach focuses on a relevant subset of serious games labelled as scenario‐based games. At the conceptual level, it identifies the basic elements that make up the static game configuration; it also describes the game dynamics, i.e. the state changes of the various game components in the course of time. At the technical level, it presents a basic system architecture, which comprises various building tools. Various building tools will be explained and illustrated with technical implementations that are part of the Emergo toolkit for scenario‐based game development. At the practical level, a set of design principles are presented for controlling and reducing game design complexity. The principles cover the topics of game structure, feedback and game representation, respectively. Practical application of the framework and the associated toolkit is briefly reported and evaluated.     

Online Affect Detection and Robot Behavior Adaptation for Intervention of Children With Autism

Investigation into robot-assisted intervention for children with autism spectrum disorder (ASD) has gained momentum in recent years. Therapists involved in interventions must overcome the communication impairments generally exhibited by children with ASD by adeptly inferring the affective cues of the children to adjust the intervention accordingly. Similarly, a robot must also be able to understand the affective needs of these children—an ability that the current robot-assisted ASD intervention systems lack—to achieve effective interaction that addresses the role of affective states in human–robot interaction and intervention practice. In this paper, we present a physiology-based affect-inference mechanism for robot-assisted intervention where the robot can detect the affective states of a child with ASD as discerned by a therapist and adapt its behaviors accordingly. This paper is the first step toward developing “understanding” robots for use in future ASD intervention. Experimental results with six children with ASD from a proof-of-concept experiment (i.e., a robot-based basketball game) are presented. The robot learned the individual liking level of each child with regard to the game configuration and selected appropriate behaviors to present the task at his/her preferred liking level. Results show that the robot automatically predicted individual liking level in real time with 81.1% accuracy. This is the first time, to our knowledge, that the affective states of children with ASD have been detected via a physiology-based affect recognition technique in real time. This is also the first time that the impact of affect-sensitive closed-loop interaction between a robot and a child with ASD has been demonstrated experimentally.      

一种移动平台儿童教育游戏的最终用户编程语言

针对现有移动教育游戏无法满足快速增长的移动教育需求这个问题,利用领域工程的方法和最终用户编程(EUP)的技术,研究和设计了一种最终用户编程语言Kids。首先通过对移动平台儿童教育领域进行分析识别出儿童教育游戏的游戏元素,在此基础上对该领域进行特征的提取,得到该领域的特征模型。Kids语言以特征模型为基础进行设计,能够允许老师和家长为学龄前的儿童编写移动教育游戏。同时,开发了一个Kids的编程工具,包括可视化编辑器和代码生成引擎。该工具能够支持用户更加有效地使用Kids进行可视化编程,并自动生成Android代码。实验结果表明,Kids相比其他通用语言更加简洁,大部分最终用户能够很好地利用Kids开发工具开发出简单的儿童教育游戏。     

基于 PCCS 色彩体系的 ASD 儿童干预 APP 配色研究

为提升自闭症谱系障碍(ASD)儿童干预 APP 的康复效果,为设计师提供合理有效的参考,提出 一种基于 PCCS 色彩体系的 ASD 儿童干预 APP 界面配色评价方法。首先通过文献分析和焦点小组法,构建基 于 PCCS 色彩体系的 ASD 儿童干预 APP 界面配色评价体系;其次运用 AHP 法获取各项评价指标的权重;再 次筛选得到 8 个基于 PCCS 色彩体系的界面配色设计方案,邀请专家对其打分,得到初始评判矩阵;然后通过 TOPSIS 法获得各方案的排序结果;最后对结果进行解析。研究表明,ASD 儿童对绿色、蓝色等冷色调及明度、 纯度较高的色彩具有较高的认可度;在 PCCS 色调图中,ASD 儿童更喜爱轻柔色调、浅色调、邻近色与互补色 的搭配;在界面配色设计中应更趋于明快、清晰、和谐、稳重的色彩搭配。将该评价方法应用于干预 APP 界 面配色实验方案评价中,可以提高设计评价过程中的客观性、科学性,为设计师进行决策提供参考,更好地促 进 ASD 儿童干预 APP 的发展。     

Playful public participation in urban planning: A case study for online serious games

The aim of this paper is to study the implementation of online games to encourage public participation in urban planning. Its theoretical foundations are based on previous work in public participatory geographical information systems (PP GISs), play and games, with a special focus on serious games. Serious games aim to support learning processes in a new, more playful way. We developed the concept of playful public participation in urban planning, including playful elements such as storytelling, walking and moving, sketching, drawing, and games. A group of students designed an online serious public participatory game entitled NextCampus. The case study used in NextCampus was taken from the real-world question of a possible move of a university campus to a new location in the city of Hamburg, Germany. The development of the serious public participatory game NextCampus resulted in a physical prototype, user interface design, and a computational model of the game. The NextCampus game was tested with the help of two groups of urban planning students and presented to three external experts who provided valuable recommendations for further development. The critical comments questioned the level of complexity involved in such games. The positive comments included recognition of the potential for joy and the playfulness a game like NextCampus could evoke.     

SKETCH'NDO: A framework for the creation of task-based serious games

We present SKETCH'NDO, a framework for the interactive design and creation of single-user task-based serious games in 3D virtual environments. The games are dimensionally congruent: inherently 2D tasks such as reading and writing are done in 2D, while manipulation tasks are 3D. The architecture of the system allows educators to design the tasks with a graphical editor that creates the game automatically. This editor does not require gaming expertise. It only needs educators to specify the correct ways of doing the task, without having to consider all possible erroneous learner's decisions. SKETCH'NDO provides a complete mechanism of monitoring and evaluation of the learner's performance that allows a precise assessment of the learning process. It offers a gradation of levels of assistance that can be fixed by educators or automatically adjusted to the trainee's skills. This way, the same task can be trained from a strictly conductist strategy to a fully constructivist one.     

Expressing and interpreting emotional movements in social games with robots

This paper provides a framework for recording, analyzing and modeling of 3 dimensional emotional movements for embodied game applications. To foster embodied interaction, we need interfaces that can develop a complex, meaningful understanding of intention—both kinesthetic and emotional—as it emerges through natural human movement. The movements are emulated on robots or other devices with sensory-motor features as a part of games that aim improving the social interaction skills of children. The design of an example game platform that is used for training of children with autism is described since the type of the emotional behaviors depends on the embodiment of the robot and the context of the game. The results show that quantitative movement parameters can be matched to emotional state of the embodied agent (human or robot) using the Laban movement analysis. Emotional movements that were emulated on robots using this principle were tested with children in the age group 7–9. The tests show reliable recognition on most of the behaviors.     

Instructional mechanisms in immersive virtual reality serious games: Earthquake emergency training for children

Children are vulnerable in earthquakes, but they are also essential to foster earthquake-resilient communities. It is critical to enhance the preparedness of children against earthquakes through effective education and training. Immersive virtual reality (IVR) and serious games (SGs) are innovative digital technologies that enable realistic and engaging training environments. However, little research has been made on the applications of IVR SGs for earthquake training targeting children. In order to fill this gap, this paper presents an IVR SG training system based on a problem-based gaming framework. Three instructional mechanisms within the training system, namely prior instruction, immediate feedback, and post-game assessment, were investigated to promote learning through effective reflection. A controlled experiment involving 125 secondary school students aged from 11 to 15 years old was undertaken, using leaflets as a traditional training approach for the control group and the IVR SG training system as the main intervention. Results revealed that the IVR SG training system with post-game assessment was the most effective way to train children, with greater knowledge acquisition and self-efficacy improvement observed. Possible improvements, such as increasing the time for reflection and differentiating the stimulation between positive and negative feedback, are suggested for further research.     

EXPERIMENTS WITH ONLINE REINFORCEMENT LEARNING IN REAL-TIME STRATEGY GAMES

Real-time strategy (RTS) games provide a challenging platform to implement online reinforcement learning (RL) techniques in a real application. Computer, as one game player, monitors opponents’ (human or other computers) strategies and then updates its own policy using RL methods. In this article, we first examine the suitability of applying the online RL in various computer games. Reinforcement learning application depends on both RL complexity and the game features. We then propose a multi-layer framework for implementing online RL in an RTS game. The framework significantly reduces RL computational complexity by decomposing the state space in a hierarchical manner. We implement an RTS game—Tank General—and perform a thorough test on the proposed framework. We consider three typical profiles of RTS game players and compare two basic RL techniques applied in the game. The results show the effectiveness of our proposed framework and shed light on relevant issues in using online RL in RTS games.     

Evaluation of learning outcomes using an educational iPhone game vs. traditional game

In this paper, we present an initial study to determine the subject preferences for educational computer games for children, in which 150 education professionals participated. From the results of this first study, we have developed an iPhone game for transmitting knowledge as part of multiculturalism, solidarity and tolerance following established learning theories, several design principles, and the objectives and competences of the Spanish law for primary education. We also report on a second study to determine whether the iPhone game has better learning outcomes than a traditional game by analyzing the participation of 84 children ranging in age from 8 to 10 years old. The frequency of playing with consoles or computer games was also taken into account in this second study, and the worldwide trend of previous studies has been corroborated. For learning outcomes, the results did not show significant differences between the two groups. However, 96% of the children indicated that they would like to play with the iPhone game again, and 90% indicated that they preferred the experience with the iPhone game over the traditional one. From these results, we can conclude that the children achieved similar knowledge improvements using both the autonomous game (iPhone game) and the custom, guided game (traditional game). This could facilitate versatility in the learning process since the learning activity could be performed at any place and time without requiring supervision. Therefore, it could be a useful tool in the learning process and help teachers to fulfill students' training needs.     

Connecting the dots: Understanding the interrelated impacts of type,quality and children's awareness of design features and the mathematics content learning goals in digital math games and related learning outcomes

This study focused on an examination of how type, quality and children's awareness of design features in digital math games, along with an awareness of the mathematics goals of the game, were related to learning outcomes. We conducted a parallel conversion mixed methods study with 45 students in Grades 3 and 4 (ages 9–10). Students participated in clinical interviews using three digital math games. The results suggest a moderated mediation relationship in which the quality of the design features moderated the mediating impact of children's awareness of the game's design features, specifically when the child was aware of the mathematics content learning goal (MCLG) of the game. These findings show how important it is that design features are of high quality in a digital math game, and how this is intertwined with children's awareness of the features and the MCLG. When these variables intertwined in just the right way, the interactions between the children and the digital math game afforded mathematical learning growth.     

A framework for the design and integration of collaborative classroom games

The progress registered in the use of video games as educational tools has not yet been successfully transferred to the classroom. In an attempt to close this gap, a framework was developed that assists in the design and classroom integration of educational games. The framework addresses both the educational dimension and the ludic dimension. The educational dimension employs Bloom’s revised taxonomy to define learning objectives and applies the classroom multiplayer presential game (CMPG) pedagogical model while the ludic dimension determines the gaming elements subject to constraints imposed by the educational dimension. With a view to validating the framework, a game for teaching electrostatics was designed and experimentally implemented in a classroom context. An evaluation based on pre/post testing found that the game increased the average number of correct answers by students participating in the experiment from 6.11 to 10.00, a result found to be statistically significant. Thus validated, the framework offers a promising basis for further exploration through the development of other games and fine-tuning of its components.     

An activity theory-based model for serious games analysis and conceptual design

There are currently a number of models, frameworks and methodologies for serious games analysis and design that provide useful interpretations of the possibilities and limitations offered by serious games. However, these tools focus mostly on high-level aspects and requirements and do not help understand how such high-level requirements can be concretely satisfied. In this paper, we present a conceptual model, called Activity Theory-based Model of Serious Games (ATMSG), that aims to fill this gap. ATMSG supports a systematic and detailed representation of educational serious games, depicting the ways that game elements are connected to each other throughout the game, and how these elements contribute to the achievement of the desired pedagogical goals. Three evaluation studies indicate that ATMSG helped participants, particularly those with gaming experience, identify and understand the roles of each component in the game and recognize the game's educational objectives.     

基于脑功能网络分析的孤独症儿童辅助干预效果研究

脑功能网络是分析复杂网络之间连接关系的一种有效方法, 对脑功能障碍分析具有重要意义. 本文基于频域Granger因果分析的定向传递函数(Direction-transfer function, DTF), 构建了各频段的脑功能网络. 采用图论方法分析最佳阈值下经颅直流电刺激(Transcranial direct current stimulation, tDCS)干预前后孤独症(Autism spectrum disorder, ASD)儿童脑网络的平均度、全局效率和平均局部效率等特征, 并对比了经颅直流电刺激对孤独症儿童脑功能状态辅助干预效果. 结果发现刺激前组在各频段的图论特征均低于刺激后组($P<0.05$), 其中Theta频段和低-beta频段的局部效率统计性差异显著, 表明在一定程度上tDCS干预是ASD儿童治疗的有效手段.     

严肃游戏中虚拟角色行为建模综述

严肃游戏是计算机游戏一个新的发展方向,可以提供形象互动的模拟教学环境,已经广泛应用于科学教育、康复医疗、应急管理、军事训练等领域。虚拟角色是严肃游戏中模拟具有生命特征的图形实体,行为可信的虚拟角色能够提升用户使用严肃游戏的体验感。严肃游戏中的图形渲染技术已经逐步成熟,而虚拟角色行为建模的研究尚在初级阶段。可信的虚拟角色必须能够具有感知、情绪和行为能力。本文分别从游戏剧情与行为、行为建模方法、行为学习和行为建模评价等4个方面来分析虚拟角色行为建模研究。分析了有限状态机和行为树的特点,讨论了虚拟角色的行为学习方法。指出了强化学习的关键要素,探讨了深度强化学习的应用途径。综合已有研究,归纳了虚拟角色行为框架,该框架主要包括感觉输入、知觉分析、行为决策和动作4大模块。从情感计算的融入、游戏剧情和场景设计、智能手机平台和多通道交互4个角度讨论需要进一步研究的问题。虚拟角色的行为建模需要综合地考虑游戏剧情、机器学习和人机交互技术,构建具有自主感知、情绪、行为、学习能力、多通道交互的虚拟角色能够极大地提升严肃游戏的感染力,更好地体现寓教于乐。     

Mobile learning vs. traditional classroom lessons: a comparative study

Different methods can be used for learning, and they can be compared in several aspects, especially those related to learning outcomes. In this paper, we present a study in order to compare the learning effectiveness and satisfaction of children using an iPhone game for learning the water cycle vs. the traditional classroom lesson. The iPhone game includes multiple interaction forms and combined augmented reality (AR) mini‐games with non‐AR mini‐games. The traditional classroom lesson had the same learning content as the iPhone game. Thirty‐eight children participated in the study. The analyses showed that the children made significant learning gains about the water cycle, regardless of the method used. Even though the results showed that the iPhone method achieved higher knowledge results than the traditional classroom lesson, no statistically significant differences were found between the iPhone and the classroom lesson. When analysing the motivational outcomes, the results showed that the children found the iPhone game to be more satisfying than the classroom lessons. Since the iPhone game achieved similar learning results and a higher motivational effect than the classroom lesson, this suggests that games of this kind could be used as a tool in primary schools to reinforce students' lessons.