Gamification in software engineering – A systematic mapping

ContextGamification seeks for improvement of the user’s engagement, motivation, and performance when carrying out a certain task, by means of incorporating game mechanics and elements, thus making that task more attractive. Much research work has studied the application of gamification in software engineering for increasing the engagement and results of developers.ObjectiveThe objective of this paper is to carry out a systematic mapping of the field of gamification in software engineering in an attempt to characterize the state of the art of this field identifying gaps and opportunities for further research.MethodWe carried out a systematic mapping with a view to finding the primary studies in the existing literature, which were later classified and analyzed according to four criteria: the software process area addressed, the gamification elements used, the type of research method followed, and the type of forum in which they were published. A subjective evaluation of the studies was also carried out to evaluate them in terms of methodology, empirical evidence, integration with the organization, and replicability.ResultsAs a result of the systematic mapping we found 29 primary studies, published between January 2011 and June 2014. Most of them focus on software development, and to a lesser extent, requirements, project management, and other support areas. In the main, they consider very simple gamification mechanics such as points and badges, and few provide empirical evidence of the impact of gamification.ConclusionsExisting research in the field is quite preliminary, and more research effort analyzing the impact of gamification in SE would be needed. Future research work should look at other game mechanics in addition to the basic ones and should tackle software process areas that have not been fully studied, such as requirements, project management, maintenance, or testing. Most studies share a lack of methodological support that would make their proposals replicable in other settings. The integration of gamification with an organization’s existing tools is also an important challenge that needs to be taken up in this field.     

Gamification Solutions to Enhance Software User Engagement—A Systematic Review

Gamification is the use of video-game mechanics and elements in nongame contexts to enhance user engagement and performance. The purpose of this study is to conduct a systematic review to have an in-depth investigation into the existing gamification solutions targeted at solving user engagement problems in different categories of software. We carried out this systematic review by proposing a framework of gamifying process, which is the basis for comparison of existing gamification solutions. In order to report the review, the primary studies are categorized according to the following: a) gamified software and their platforms; b) elements of the gamifying process; c) gamification solutions in each software type; d) gamification solutions for software user engagement problems; e) gamification solutions in general; and f) effects of gamification on software user engagement and performance. Based on the search procedure and criteria, a total of 78 primary studies were extracted. Most of the studies focused on educational and social software, which were developed for web or mobile platforms. We concluded that the number of studies on motivating users to use software content, solving problems in learning software, and using real identity is very limited. Furthermore, few studies have been carried out on gamifying the following software categories: productivity software, cloud storage, utility software, entertainment software, search engine software, tool software, fitness software, software engineering, information worker software, and health-care software. In addition, a large number of gamification solutions are relatively simple and require improvement. Thus, for future studies, researchers can work on the items discovered in this review; they can improve the quality of the current gamified systems by using a wide variety of game mechanics and interface elements, utilizing a combination of contextual types of rewards and giving users the ability to use received rewards “in-game” and “out-game.”     

A systematic mapping study of gamification models oriented to motivational characteristics

ABSTRACT

Context: Gamification focuses on the improvement of users' engagement when performing tasks by making use of game mechanics and elements in order to increase their motivations. Many researches have developed gamification models supporting a variety of motivational characteristics to provide engagement solutions for different areas. Objective: This paper carries out a systematic mapping in the field of gamification, looking for models with motivational characteristics in an attempt to characterise the state of the art of this field, identifying gaps and tendencies for further research. Method: We carried out a systematic mapping aiming at finding the primary studies in the existing literature, which were later classified and analysed according to twelve criteria. Results: We analysed 70 papers that resulted in 17 primary studies, published until September 2016. Most of them focus on Education, making use of Gamification to increase the motivation of a learning process. The gamification mechanics and elements most used were Badges/Achievements and Points/ExperiencePoints(XP), and most of the studies were not validated, thus not providing empirical evidence of the impact of gamification. Conclusions: Existing research in the field is somehow preliminary, and more research effort to analyse the applicability of the models and their respective evaluations would be needed.     

针对色彩教育的游戏化设计及效果分析

当前的研究普遍关注于运用游戏化来提高学习的参与度，但对于色彩教育这样的特定领域的游戏化研究还不充分，而且缺少对游戏化要素及学习效果影响因素的分析。针对这一问题，设计了一款用于训练色彩辨识能力的游戏模型。首先设计了核心玩法相同、但交互方式不同的两种玩法；然后在这两种玩法中都加入了相同的虚拟奖励；最后分别比较在有或无虚拟奖励的情况下两种玩法对训练效果的影响，以及在相同玩法下有无虚拟奖励对训练效果的影响。结果显示，玩法设计影响学习效率，而虚拟奖励显著影响参与度。     

Deconstructing gamification: evaluating the effectiveness of continuous measurement,virtual rewards,and social comparison for promoting physical activity

Game design elements are often implemented in persuasive systems aimed to promote physical activity, a process called “gamification.” Gamification is believed to motivate users to become more active, and is commonly implemented in commercial products. However, relatively few studies rigorously evaluated the effectiveness of gamification, and they yielded contradicting findings. We set out to evaluate the effectiveness of virtual rewards and social comparison—two game elements prevalent in persuasive systems. We developed a research prototype, called “StepByStep,” aimed to promote routine walking. We created different versions of StepByStep, implemented as an application on Android-based mobile devices, and compared their effectiveness in two field studies. Study 1 showed that a quantified version of the application—offering continuous measurement of walking time, a daily goal, and real-time feedback on progress toward this goal—facilitated reflection on activity and significantly increased walking time over baseline level. Study 2 showed that gamified versions offering virtual rewards and social comparison were only as effective as the quantified version. Thus, we advise designers to facilitate reflection on meaningful aspects of physical activity by developing novel ubiquitous measures. Furthermore, our findings highlight the importance of systematic comparisons between quantified and gamified elements for better understanding their motivational affordances.     

The design of a hybrid cultural model for Arabic gamified systems

The growing popularity of gamification in the global environment increases the importance of balancing factors that affect user engagement, satisfaction and acceptability in different cultures. While the main motivation behind gamifying software systems is to improve user engagement, an adverse effect might happen if the design and functionality did not consider users' cultural requirements. This paper presents a hybrid cultural design model for localising Arabic systems that takes into consideration the visual elements of user interfaces as well as the functionality and cultural factors of Arabic countries. We start by introducing design guidelines for localising Arabic systems and then evaluate the designed localisation criteria by conducting questionnaires and interviews. We base our studies on the factors that could affect the productivity levels of software engineers who use gamified software project management tools in their workplace. 63 software engineers participated in a mood board based questionnaire composed by different visual elements, rewards and achievements. To validate our findings, seven experts were interviewed. Those were software developers and designers. Based on our results, we propose a hybrid cultural design model, composed of personalised elements, localised elements and non-localised elements. This paper also proposes the first comprehensive model for localising Arabic gamified systems.     

Does ease-of-use contributes to the perception of enjoyment? A case of gamification in e-banking

The success of online games encouraged the development of gamification software in e-banking. Beside the growing trend of gamification, it is important understand how bank customers face the gamified applications, particularly as enjoyment and ease-of-use. To assess the determinants that influence the adoption of gamification in e-banking, we developed a research to propose a conceptual model that illustrates the adoption of gamified business applications by bank customers, in e-banking context. We conducted two quantitative studies (A and B) to understand how bank customers represent a gamified business software and its changes (or improvements) over time. Study A was performed in 2012 (N = 183), and study B in 2015 (N = 219). Online bank customers were invited to rate the importance of variables related to: socialness, ease-of-use, usefulness, enjoyment and intention to use e-banking systems with game features and social cues. The results show that ease-of-use and enjoyment are interrelated, and both have influence in e-banking usage. This study present theoretical ground of the conceptual model, and discuss two empirical studies, aiming to analyse the ease-of-use and enjoyment influence on bank customers. These findings will contribute directly to explain of adoption hedonic business software in e-banking.     

Designing interactive systems through a game lens: An ethnographic approach

This research has the aim to find new meaningful elements, in the video game world, that could inspire the design of novel gamified systems. Starting from the players’ point of view, I looked at the field of the Massively Multi Player Online Role-Playing Games as a source of inspiration, conducting an ethnographic study in World of Warcraft. Thus, drawing on the findings gathered in my empirical work, I identified 9 recommendations to suggest new directions for the gamification design of interactive systems. Some of these recommendations are devised to suit the applications that pivot on user social participation. Others are aimed at imagining new forms of online communities. Others address those interactive systems that aim at changing user behaviors. These recommendations, by suggesting to support the development of intrinsic motivations, proposing new and diversified game elements and recommending to look at systemic design strategies, aim at addressing the limits of the current gamification techniques. At the high grade of abstraction they are left, they are meant to be applied to different fields.     

Gamification: A framework for designing software in e-banking

The gamification software development gave emphasis to the role played by the users to test and improve the software. This study presents a framework for software gamified in e-banking, taking a users' groups and a qualitative research approach, to check the users' design preferences in five cases of banking software gamified (Futebank, Dreams, Galaxy, Olympics, and Warrants). After software presentation, and usage experience, 53 participants, responses to a survey with six open questions. The data were analyzed through a text semantic software, to detect and classify lexical items in, accordance, with standard of software quality characteristics and user experiences. Two primary categories were identified, as well five dimensions in each element and characteristic categories. The results show five characteristic dimensions (design, appearance, functionality, rules, and objectives) and five element dimension (game, product, security, process, and information). These findings provide a framework for web designers and e-business, highlighting the most important software features when dealing with serious applications with game design. It adds value to the current literature on understanding the customer relationship with the game and the financial product, identifying new dimensions (game and product) on the approach of thinking and design gamification in e-banking. Our finding contributes to a better understanding of key elements and characteristics in e-banking software design and has important practical implications for software development and marketing practices. Thoughts on the users' software design preferences identified, should propel increase adoption and attractiveness of online banking.     

Playing seriously – How gamification and social cues influence bank customers to use gamified e-business applications

The development of business applications with game features has given rise to a new trend called gamification and challenged e-banking to introduce new game elements, such as mechanics and social cues, to its traditional applications. Yet, there has been a lack of empirical evidence regarding the intention to use, these type of applications and their possible impacts on business. Here, we explore the role of gamification, socialness, and other four well-known variables (ease-of-use, usefulness, enjoyment, and intention to use) in a gamified business application and corresponding business. We proposed and evaluated a model based on the Technology Acceptance Model to better analyze and understand the adoption of gamified business applications. To test this model, we developed a study using a sample of 183 bank customers, and we found that gamification significantly improved the customer’s sense of social interaction, which, in turn, strongly influenced the customer’s intention to use the applications. We argue that this intention to use could provide a strong benefit to the business, in term of increased customer engagement. This paper presents a new conceptual model to predict behavioral intention in regards to gamification in e-banking, illustrating seven variables that affect the adoption of e-banking by bank customers. Our findings contribute overall to a better understanding of gamification in e-banking (with the extension of Technology Acceptance Model theories, and the new variable gamification), providing important practical implications for software development and marketing practices.     

Co‐creation of new solutions through gamification: A collaborative innovation practice

This paper aims to explore the main implications of gamification approaches to collaborative innovation and particularly to co‐creation, i.e. the interaction and interchange of ideas between users, customers, suppliers and other actors in the development of new solutions. Despite the few approaches attempting to make co‐creation more ludic and accessible, researchers have yet to analyse the link between gamification and co‐creation in an extensive manner. In order to better understand this unexplored relationship, empirical case research studies have been conducted with multi‐actors participating in a real‐life co‐creation project through the deployment of a gamified method and tool (ideaChef®), as well as a combination of different instruments, involving speed meetings, workshops, debriefings and interviews. Besides advancing the body of knowledge on collaborative innovation practices and conceptualizing the relationship between gamification and co‐creation, this paper provides important implications for managers on how multiple actors can be engaged and coordinated in such practices through gamification. The paper's main contribution lies in the suggestion that engagement goes hand in hand with coordination, and that a combination of both will be the best strategy for co‐creating new solutions through gamification.     

Gamification in theory and action: A survey

Gamification has drawn the attention of academics, practitioners and business professionals in domains as diverse as education, information studies, human–computer interaction, and health. As yet, the term remains mired in diverse meanings and contradictory uses, while the concept faces division on its academic worth, underdeveloped theoretical foundations, and a dearth of standardized guidelines for application. Despite widespread commentary on its merits and shortcomings, little empirical work has sought to validate gamification as a meaningful concept and provide evidence of its effectiveness as a tool for motivating and engaging users in non-entertainment contexts. Moreover, no work to date has surveyed gamification as a field of study from a human–computer studies perspective. In this paper, we present a systematic survey on the use of gamification in published theoretical reviews and research papers involving interactive systems and human participants. We outline current theoretical understandings of gamification and draw comparisons to related approaches, including alternate reality games (ARGs), games with a purpose (GWAPs), and gameful design. We present a multidisciplinary review of gamification in action, focusing on empirical findings related to purpose and context, design of systems, approaches and techniques, and user impact. Findings from the survey show that a standard conceptualization of gamification is emerging against a growing backdrop of empirical participants-based research. However, definitional subjectivity, diverse or unstated theoretical foundations, incongruities among empirical findings, and inadequate experimental design remain matters of concern. We discuss how gamification may to be more usefully presented as a subset of a larger effort to improve the user experience of interactive systems through gameful design. We end by suggesting points of departure for continued empirical investigations of gamified practice and its effects.     

Exploring Design Guidelines of Using User-Centered Design in Gamification Development: A Delphi Study

Gamification has become an increasingly important trend in the field of human–computer interaction (HCI) design. Applying the idea of user-centered design (UCD) in gamification is drawing more and more attention as the gamification design theoretical frameworks referencing UCD have been proposed. However, questions like “How should a gamification project be developed with specific UCD methods?” and “What design guidelines could be applied in the practice of using UCD in gamification project?” remain unanswered. We hereby conducted a Delphi study to explore design guidelines for using UCD in gamification development with knowledge from practice. The Delphi panel recruited for this study included 20 experienced gamification designers, who produced 28 initial guideline items in the pre-Delphi round. After three rounds of addition, modification, and deletion, 35 design guidelines were ultimately identified. Among these, 31 were found process-oriented and in line with the classic UCD processes and the rest four were about collecting feedback from the design user participants. The author discovered that some of the design guidelines showed consistency with existing theoretical frameworks or design principles about gamification and UCD, and meanwhile, some appeared to be different from the known gamification design knowledge. The research results extended and complemented current gamification design field by providing maneuverable guides and a better overall understanding of how to conduct a gamification project with UCD for gamification researchers and practitioners. In addition, by using the Delphi method in the field of gamification, this study provided a reference to future research in HCI design which needed to draw lessons from practical knowledge.     

Developing a knowledge-based perspective on coordination: The case of global software projects

We have attempted to bring together two areas which are challenging for both IS research and practice: forms of coordination and management of knowledge in the context of global, virtual software development projects. We developed a more comprehensive, knowledge-based model of how coordination can be achieved, and\illustrated the heuristic and explanatory power of the model when applied to global software projects experiencing different degrees of success. We first reviewed the literature on coordination and determined what is known about coordination of knowledge in global software projects. From this we developed a new, distinctive knowledge-based model of coordination, which was then employed to analyze two case studies of global software projects, at SAP and Baan, to illustrate the utility of the model.     

A social gamification framework for a K-6 learning platform

As video games, particularly, social games are growing in popularity and number of users, there has been an increasing interest in its potential as innovative teaching tools. Gamification is a new concept intending to use elements from video games in non-game applications. Education is an area with high potential for application of this concept since it seeks to promote people’s motivation and engagement. The research in progress will try to find how to apply social gamification in education, testing and validating the results of that application. To fulfil these objectives, this paper presents the guidelines and main features of a social gamification framework to be applied in an existent K-6 social learning environment.     

Enhancing User Engagement through Gamification

Gamification—the use of game elements in non-game contexts—is gaining interest among researchers and practitioners. How gamification enhances user engagement, though, remains unclear, largely due to the lack of a theoretical framework. To narrow the theory gap, this study develops a theoretical model, which draws on cognitive evaluation theory to explain the effects of game dynamics on user engagement, and tests it using data collected from 164 users of a gamified information system. The results reveal that gamification enhances user engagement through the mediation of psychological needs satisfaction (autonomy, competence, and relatedness) between game dynamics and enjoyment. The results suggest that gamification should go beyond merely providing fun and enjoyment; gamification should also generate diverse game dynamics, such as rewards, competition, altruism, and self-expression in a way that helps people to satisfy their psychological needs. The study contributes to a more nuanced understanding of the success of gamification.     

A system framework for gamified Cost Engineering

This study develops a system framework and an enterprise IT solution for integrating gamification elements to efficiently implement and continuously perform Cost Engineering. Cost Engineering is a systematic approach to manage knowledge and competencies regarding costs reduction measures throughout the life cycle of products and is technology, resource and time intensive. Gamification as a non-monetary multidimensional incentive system holds great potential to implement and establish Cost Engineering in a novel and less resource demanding manner and stipulate knowledge sharing and dissemination. Building on a review of the relevant literature we conducted 20 interviews with experts from eight companies of the German and Austrian high-tech manufacturing industry to examine the system requirements from an organizational perspective. Analyzing the interviews, we found that companies need a flexible platform where the game elements help to align management objectives with concrete tasks, meet legislative regulations and have different evaluation methods. Our proposed system framework combines the organizational and IT requirements with gamification elements to efficiently steer Cost Engineering methods and best manage knowledge and competencies.     

Constraint-driven modeling through transformation

In model-driven software engineering, model transformation plays a key role for automatically generating and updating models. Transformation rules define how source model elements are to be transformed into target model elements. However, defining transformation rules is a complex task, especially in situations where semantic differences or incompleteness allow for alternative interpretations or where models change continuously before and after transformation. This paper proposes constraint-driven modeling where transformation is used to generate constraints on the target model rather than the target model itself. We evaluated the approach on three case studies that address the above difficulties and other common transformation issues. We also developed a proof-of-concept implementation that demonstrates its feasibility. The implementation suggests that constraint-driven transformation is an efficient and scalable alternative and/or complement to traditional transformation.     

Guidelines for conducting and reporting case study research in software engineering

Case study is a suitable research methodology for software engineering research since it studies contemporary phenomena in its natural context. However, the understanding of what constitutes a case study varies, and hence the quality of the resulting studies. This paper aims at providing an introduction to case study methodology and guidelines for researchers conducting case studies and readers studying reports of such studies. The content is based on the authors’ own experience from conducting and reading case studies. The terminology and guidelines are compiled from different methodology handbooks in other research domains, in particular social science and information systems, and adapted to the needs in software engineering. We present recommended practices for software engineering case studies as well as empirically derived and evaluated checklists for researchers and readers of case study research.