The role of IT in organizational innovation – A systematic literature review

Information technology (IT) is broadly recognized as an important element in organizational innovation, however there has been relatively little integration of Information Systems (IS) research on the role of IT in organizational innovation. Such integration is particularly important in view of recent calls to examine the evolving ontological nature of IT, wherein IT artifacts are now shaping physical reality. We systematically examine innovation-related literature published in the leading IS journals in the period between 2009 and 2020 and we identify and summarize the core theoretical discourses in this domain. We find that extant literature largely examines the role of IT in innovation at a high level of abstraction, focusing on IT investments and IT capabilities, and consequently precluding granular insights on who, what, when, where, how, and why in relation to organizational innovation. To address this limitation and to provide a structuring lens for future research, we develop the organizational innovation system framework which posits that actors, IT artifacts, actions and organizational context are the key elements in organizational innovation systems that require more granular examination to yield deeper insights on how information technology contributes to organizational innovation. We re-examine the literature through the organizational innovation system lens and we identify gaps in extant research. We also outline potential directions for expanding the scope of future research.     

Adoption of open source software in software-intensive organizations – A systematic literature review

ContextOpen source software (OSS) is changing the way organizations develop, acquire, use, and commercialize software.ObjectiveThis paper seeks to identify how organizations adopt OSS, classify the literature according to these ways of adopting OSS, and with a focus on software development evaluate the research on adoption of OSS in organizations.MethodBased on the systematic literature review method we reviewed publications from 24 journals and seven conference and workshop proceedings, published between 1998 and 2008. From a population of 24,289 papers, we identified 112 papers that provide empirical evidence on how organizations actually adopt OSS.ResultsWe show that adopting OSS involves more than simply using OSS products. We moreover provide a classification framework consisting of six distinctly different ways in which organizations adopt OSS. This framework is used to illustrate some of the opportunities and challenges organizations meet when approaching OSS, to show that OSS can be adopted successfully in different ways, and to organize and review existing research. We find that existing research on OSS adoption does not sufficiently describe the context of the organizations studied, and it fails to benefit fully from related research fields. While existing research covers a large number of topics, it contains very few closely related studies. To aid this situation, we offer directions for future research.ConclusionThe implications of our findings are twofold. On the one hand, practitioners should embrace the many opportunities OSS offers, but consciously evaluate the consequences of adopting it in their own context. They may use our framework and the success stories provided by the literature in their own evaluations. On the other hand, researchers should align their work, and perform more empirical research on topics that are important to organizations. Our framework may be used to position this research and to describe the context of the organization they are studying.     

Refining the systematic literature review process—two participant-observer case studies

Systematic literature reviews (SLRs) are a major tool for supporting evidence-based software engineering. Adapting the procedures involved in such a review to meet the needs of software engineering and its literature remains an ongoing process. As part of this process of refinement, we undertook two case studies which aimed 1) to compare the use of targeted manual searches with broad automated searches and 2) to compare different methods of reaching a consensus on quality. For Case 1, we compared a tertiary study of systematic literature reviews published between January 1, 2004 and June 30, 2007 which used a manual search of selected journals and conferences and a replication of that study based on a broad automated search. We found that broad automated searches find more studies than manual restricted searches, but they may be of poor quality. Researchers undertaking SLRs may be justified in using targeted manual searches if they intend to omit low quality papers, or they are assessing research trends in research methodologies. For Case 2, we analyzed the process used to evaluate the quality of SLRs. We conclude that if quality evaluation of primary studies is a critical component of a specific SLR, assessments should be based on three independent evaluators incorporating at least two rounds of discussion.     

Design science research contribution to business intelligence in the cloud — A systematic literature review

Business intelligence (BI) helps managers make informed decisions. In the age of big data, BI technology provides essential support for decision making. Cloud computing also attracts many organizations because of its potential: ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g. networks, servers, storage, applications, and services). This paper focuses on the deployment of BI in the cloud, from the vantage point of design science research (DSR). We produce a state of the art of research pertaining to BI in the cloud, following the methodology of systematic literature review. This literature review especially exhibits the different artifacts proposed by design science researchers regarding BI in the cloud. To structure the literature review, we propose a framework composed of two dimensions: artifact type and BI step. In particular, we propose a typology of artifact types, refining the coarse-grained typology commonly used in DSR. We use the two-dimensional framework both to map the current state of DSR regarding BI in the cloud, and to elicit future research avenues in terms of design science artifacts for BI in the cloud. The contribution is threefold: the literature review may help DSR researchers get an overview of this active research domain; the two-dimensional framework facilitates the understanding of different research streams; finally, the proposed future topics may guide researchers in identifying promising research avenues.     

Does peer assessment in on-line learning environments work? A systematic review of the literature

There is an increase use of Peer Assessment (PA) approaches in On-line Learning Environments to support students and teachers on educational process. However, the community still lacks a comprehensive understanding of how Peer Assessment behaves within these educational environments, since there are no studies that make an analysis of the researches which has been conducted in this context, analysing the benefits and disadvantages of the use of Peer Assessment. Thus, the main goal of this work is to investigate and better understand how PA contributes in student learning as well as can bring benefits to the teachers involved. In order to meet our goal, we conducted a systematic literature review (SLR). In summary, the main findings are: (1) there are empirical evidences of the benefits of using PA in both industry and academy, and in several educational levels; (2) PA is most addressed to the correction of written activities on on-line courses; (3) About 60% of the articles showed PA improvement in student performance; (4) About 1/3 of the studies showed PA brings some benefits to teachers; (5) In some studies the use of the PA had difficulties, especially issues related to student motivation, which impairs the peer review process.     

Monitoring web services’ quality of service: a literature review

Monitoring Quality of Service (QoS) compliance is an important procedure in web service environment. It determines whether users’ expectations are met, and becomes the vital factor for them to decide whether to continue paying for the service or not. The monitoring is performed by checking the actual services performance against the QoS stated in Service Level Agreement (SLA). In relation to that, the need for monitoring vague QoS specifications in SLA has become more apparent nowadays. This paper reviews the published literature on web services QoS monitoring. A total of 60 selected articles were systematically analyzed. There were 23 of the articles selected through restrictive search criteria while the other 37 were selected based on unrestrictive search criteria. The review shows that little evidence exists on monitoring vague QoS specifications of web services. Providing ability for monitoring QoS that is specified vaguely in SLA could give new insights and implications to web services field. This paper concludes with some recommended future works to construct the theory and perform the empirical research.     

Using metrics in Agile and Lean Software Development – A systematic literature review of industrial studies

ContextSoftware industry has widely adopted Agile software development methods. Agile literature proposes a few key metrics but little is known of the actual metrics use in Agile teams.ObjectiveThe objective of this paper is to increase knowledge of the reasons for and effects of using metrics in industrial Agile development. We focus on the metrics that Agile teams use, rather than the ones used from outside by software engineering researchers. In addition, we analyse the influence of the used metrics.MethodThis paper presents a systematic literature review (SLR) on using metrics in industrial Agile software development. We identified 774 papers, which we reduced to 30 primary studies through our paper selection process.ResultsThe results indicate that the reasons for and the effects of using metrics are focused on the following areas: sprint planning, progress tracking, software quality measurement, fixing software process problems, and motivating people. Additionally, we show that although Agile teams use many metrics suggested in the Agile literature, they also use many custom metrics. Finally, the most influential metrics in the primary studies are Velocity and Effort estimate.ConclusionThe use of metrics in Agile software development is similar to Traditional software development. Projects and sprints need to be planned and tracked. Quality needs to be measured. Problems in the process need to be identified and fixed. Future work should focus on metrics that had high importance but low prevalence in our study, as they can offer the largest impact to the software industry.     

A systematic review on security in Process-Aware Information Systems – Constitution,challenges, and future directions

ContextSecurity in Process-Aware Information Systems (PAIS) has gained increased attention in current research and practice. However, a common understanding and agreement on security is still missing. In addition, the proliferation of literature makes it cumbersome to overlook and determine state of the art and further to identify research challenges and gaps. In summary, a comprehensive and systematic overview of state of the art in research and practice in the area of security in PAIS is missing.ObjectiveThis paper investigates research on security in PAIS and aims at establishing a common understanding of terminology in this context. Further it investigates which security controls are currently applied in PAIS.MethodA systematic literature review is conducted in order to classify and define security and security controls in PAIS. From initially 424 papers, we selected in total 275 publications that related to security and PAIS between 1993 and 2012. Furthermore, we analyzed and categorized the papers using a systematic mapping approach which resulted into 5 categories and 12 security controls.ResultsIn literature, security in PAIS often centers on specific (security) aspects such as security policies, security requirements, authorization and access control mechanisms, or inter-organizational scenarios. In addition, we identified 12 security controls in the area of security concepts, authorization and access control, applications, verification, and failure handling in PAIS. Based on the results, open research challenges and gaps are identified and discussed with respect to possible solutions.ConclusionThis survey provides a comprehensive review of current security practice in PAIS and shows that security in PAIS is a challenging interdisciplinary research field that assembles research methods and principles from security and PAIS. We show that state of the art provides a rich set of methods such as access control models but still several open research challenges remain.     

Player–video game interaction: A systematic review of current concepts

Video game design requires a user-centered approach to ensure that the experience enjoyed by players is as good as possible. However, the nature of player–video game interactions has not as yet been clearly defined in the scientific literature. The purpose of the present study was to provide a systematic review of empirical evidences of the current concepts of player–video game interactions in entertainment situations. A total of 72 articles published in scientific journals that deal with human–computer interaction met the criteria for inclusion in the present review. Major findings of these articles were presented in a narrative synthesis. Results showed that player–video game interactions could be defined with multiple concepts that are closely linked and intertwined. These concepts concern player aspects of player–video game interactions, namely engagement and enjoyment, and video game aspects, namely information input/output techniques, game contents and multiplayer games. Global approaches, such as playability, also exist to qualify player–video game interactions. Limitations of these findings are discussed to help researchers to plan future advances of the field and provide supplementary effort to better know the role of less-studied aspects. Practical implications are also discussed to help game designers to optimize the design of player–video game interactions.     

Does the technology acceptance model predict actual use? A systematic literature review

ContextThe technology acceptance model (TAM) was proposed in 1989 as a means of predicting technology usage. However, it is usually validated by using a measure of behavioural intention to use (BI) rather than actual usage.ObjectiveThis review examines the evidence that the TAM predicts actual usage using both subjective and objective measures of actual usage.MethodWe performed a systematic literature review based on a search of six digital libraries, along with vote-counting meta-analysis to analyse the overall results.ResultsThe search identified 79 relevant empirical studies in 73 articles. The results show that BI is likely to be correlated with actual usage. However, the TAM variables perceived ease of use (PEU) and perceived usefulness (PU) are less likely to be correlated with actual usage.ConclusionCare should be taken using the TAM outside the context in which it has been validated.     

Expert system applications in business: A review and analysis of the literature (1977–1993)

A survey of expert system (ES) business application papers published between 1977 and 1993 indicates that an increasing amount of ES research is being conducted for a diverse range of business activities. The classification of literature by (1) year of publication, (2) application area, (3) generic problem area addressed, (4) problem domain, (5) level of management, (6) level of task interdependence, (7) means of development, (8) corporate/academic interaction in development, and (9) technology integration provides some insights in the trend. Implications to ES developers are discussed.     

Virtual or vague? a literature review exposing conceptual differences in defining virtual organizations in IS research

The concept of ??virtual organization?? was coined about 15?years ago to describe changes in organizational structures and value creation, enabled by the affordances of ICT. Not surprisingly, the Information Systems community has been influential in researching virtual organization phenomena. However, it appears that, since the notion of ??virtual?? in its most basic connotation only denotes some form of difference to a ??traditional?? form of organization, the term VO has been interpreted in varied form with an unsatisfying mix of VO notions existing in the literature. What is more, papers frequently exhibit mismatches between what they characterize as VO and the real-life phenomena they discuss. Motivated by these observations we carry out a literature analysis to explore differing notions of virtual organization. Based on a systematic classification of VO definitions, we uncover three distinct types of VO that are used in the literature, each of which interprets the notion of ??virtual?? differently, but is useful in its own right and exhibits unique management challenges. The first type, named Internal VO, revolves around internal virtualization based on distributed collaboration in virtual teams. It emerged on the back of emerging new groupware and communication technologies. Its main challenges stem from distributed project and work organization. The second type, named Network VO, describes a network of smaller companies that form a virtual entity, bringing in core competencies in short term collaborative projects. It emerged on the back of a emerging inter-organizational information systems and a trend of forming network arrangement. Its main challenges are with the governance of the multi-entity network. The third type, termed Outsourcing VO, refers to a hierarchical network of suppliers to which the focal firm outsources a significant part of its value creation, thus appearing as a virtual firm. It emerged on the back of the outsourcing trend of the last decades. Its main challenge is determining the optimal degree of integration and virtualization. With the identification and detailed exploration of the three VO types, our study contributes to a better understanding of the conceptual foundation of VO research and points to the necessity for conceptual clarity in future research.     

De-coding Our Scholarship: The State of Research in Computers and Writing from 2003–2008

Since its inception, the field of computers and writing has responded to rapid technological advancements that affect the research, practice, and teaching of writing. A potential consequence of addressing these advancements in teaching and practice, however, may be a reduced focus on foundational, empirical research. To examine the state of research in the field of computers and writing, we assessed the types of research published in four journals (Computers and Composition print, Computers and Composition Online, Kairos, and College Composition and Communication (CCC)) from late 2003/early 2004 to the end of 2008. We explored the state of research by investigating research approaches, design, and modes of inquiry over time. Within this context, we considered author gender, collaboration, and employment of interdisciplinary and mixed methods. We applied criteria from MacNealy (1998) to classify 26% of the computers and writing articles we analyzed as rigorous empirical research. We found a preference for qualitative research designs (56% of articles were qualitative) and, to a lesser degree, mixed methods (29%). While providing a sense of the state of the field as it matures, we conclude by presenting discussion questions on the role of research, research drivers, and ways to increase the quality of research and research reporting. We urge the field to consider the kinds of research we do, teach, and value.     

Human–robot collaboration and machine learning: A systematic review of recent research

Technological progress increasingly envisions the use of robots interacting with people in everyday life. Human–robot collaboration (HRC) is the approach that explores the interaction between a human and a robot, during the completion of a common objective, at the cognitive and physical level. In HRC works, a cognitive model is typically built, which collects inputs from the environment and from the user, elaborates and translates these into information that can be used by the robot itself. Machine learning is a recent approach to build the cognitive model and behavioural block, with high potential in HRC. Consequently, this paper proposes a thorough literature review of the use of machine learning techniques in the context of human–robot collaboration. 45 key papers were selected and analysed, and a clustering of works based on the type of collaborative tasks, evaluation metrics and cognitive variables modelled is proposed. Then, a deep analysis on different families of machine learning algorithms and their properties, along with the sensing modalities used, is carried out. Among the observations, it is outlined the importance of the machine learning algorithms to incorporate time dependencies. The salient features of these works are then cross-analysed to show trends in HRC and give guidelines for future works, comparing them with other aspects of HRC not appeared in the review.     

Particle swarm optimisation in designing parameters of manufacturing processes: A review (2008–2018)

The evolutionary optimisation algorithms appeared as an effective alternative to conventional statistical methods that have certain limitations in optimising complex manufacturing processes. Considering works published in the last decade, this paper presents an analysis of the particle swarm optimisation (PSO) implementation in designing parameters of heterogeneous manufacturing processes, both conventional and emerging, new processes. The literature review and analysis was structured according to the complexity of the optimisation problem (single response and multiresponse problems), and the development of an objective function for PSO. The tuning of the PSO algorithm-specific parameters was analysed in detail. The PSO algorithm performance was benchmarked with the results of other methods, including evolutionary algorithms, in designing process parameters. The concerns in applying PSO for multiresponse manufacturing problems were highlighted, and recommendations for future research were drawn. Such a comprehensive review on the PSO application in optimising manufacturing processes, including the detailed discussion on the algorithm characteristics and benchmark with other optimisation procedures, has not been pursued so far. Therefore, this review analysis provides hands on information for researchers and engineers at one place, and it is believed that the findings could serve as a basis for the future research and implementation directions.     

An overview of web accessibility in Greece: a comparative study 2004–2008

This communication reports on the results of a web accessibility audit of public Web sites in Greece. The audit was conducted in 2008 by the Human Computer Interaction Laboratory of the Institute of Computer Science of FORTH, in its capacity as the Greek National Contact Centre of the European Design for All e-Accessibility Network. In an earlier e-Accessibility study in 2004, that evaluated approximately 250 public and commercial Web sites in Greece, 73% of the sample failed to meet the most basic requirements for web accessibility (). Four years later, in the context of a re-audit, a similar sample was examined for compliance with the same web accessibility standard (WCAG 1.0), as set by the Web Accessibility Initiative of the World Wide Web Consortium. The accessibility checks were conducted during the period from March to September 2008. A comparison of the results indicates that although new web development technologies may have been employed, instead of improving the overall status of e-accessibility, this has resulted in a serious deterioration in overall accessibility levels. Such findings—85% of sites failed to comply with Level A—suggest that Greek Web sites are likely to present even more significant access barriers to people with disability than in the past. As Web Accessibility is poorly understood and, until today, new platforms have failed to deliver products that conform to WCAG, the need emerges for a concrete legislative framework to set accessibility specifications for all public Web sites in Greece.     

A systematic review – physical activity in dementia: The influence of the nursing home environment

Most older persons with dementia living in nursing homes spend their days without engaging in much physical activity. This study therefore looked at the influence that the environment has on their level of physical activity, by reviewing empirical studies that measured the effects of environmental stimuli on the physical activity of nursing home residents suffering from dementia. The electronic databases PubMed, PsycINFO, EMBASE, CINAHL and the Cochrane Library were used for the search. The search covered studies published between January 1993 and December 2012, and revealed 3187 abstracts. 326 studies were selected as potentially relevant; of these, 24 met all the inclusion criteria. Positive results on the residents' levels of physical activity were found for music, a homelike environment and functional modifications. Predominantly positive results were also found for the small-scale group living concepts. Mixed results were found for bright or timed light, the multisensory environment and differences in the building footprint.