Pluralist action research: a review of the information systems literature*

Action research (AR) has for many years been promoted and practised as one way to conduct field studies within the information systems (IS) discipline. Based on a review of articles published in leading journals, we explore how IS researchers practise AR. Our review suggests that AR lends itself strongly towards pluralist approaches which facilitate the production of both theoretical and practical knowledge. First, on the level of each study we analyse how research and problem‐solving activities are mixed, in three ways: the research dominant, the problem‐solving dominant and the interactive approaches. Second, in the context of the wider research programme in which the study is situated, we analyse how AR is mixed with other research methods, in two ways: the dominant and the sequential approaches. We argue that these pluralist practices of mixing types of research activities and types of research methods provide IS action researchers with a rich portfolio of approaches to knowledge production. This portfolio helps them address the risks involved in AR to ensure their efforts contribute to the literature as well as to practical problem‐solving.     

Invited Viewpoint: How well does the Information Systems discipline fare in the Financial Times’ top 50 Journal list?

This paper investigates the performance of the Information Systems (IS) discipline as reflected in the scholarly impact of the three IS journals that are included in the Financial Times’ top 50 journals (FT50), the four IS journals in the top tiers of the Chartered Association of Business Schools’ Academic Journal Guide (CABS AJG), and the eight journals that comprise the Association for Information Systems (AIS) Senior Scholars' Basket of Journals (AIS Basket). Journal lists, when framed as a form of ‘strategic signaling’, are used to by institutions to communicate values and priorities to scholars. Through strategic signaling, journal lists are performative and have the potential to shape and constrain research activity. Given the strategic and performative role of journal lists, it is important that the journals that constitute those lists have substantial impact. To measure the scholarly impact of journals we propose a new measure, the HMJ index, which comprises an equally-weighted combination of journal H-index, median citations per article, and Journal Impact Factor (JIF). Using the HMJ index, the results show that all eight AIS Basket journals are performing at a level that is commensurate with the other journals that make up the FT50. The results further show substantial differences between the FT50 journals, such as the number of articles published per annum. Implications for IS scholars, IS groups, and the IS discipline are identified, together with recommendations for action.     

The wisdom nexus: Guiding information systems research,practice, and education

“Wisdom” has been at the heart of practical, philosophical, and spiritual disciplines since antiquity and is now increasingly receiving organizational as well as academic attention in scholarly areas that include psychology and organizational studies among others. However, practical wisdom has not received adequate focus in the information systems (IS) discipline. In this commentary, we make the case for a systemic focus on the role of wisdom in IS research, teaching, and practice. We introduce underlying theoretical concepts of wisdom; review relevant key research linking wisdom and IS; propose a framework to link wisdom with IS research, practice, and education; and discuss the implications of the framework and illustrate how it can be used to generate research opportunities for IS. We conclude that wisdom, whose goal is the common good, can provide a foundation to discover, view, understand, and resolve myriad issues that lie at the nexus of wisdom and information technologies.     

Information systems as a discipline in the making: comparing <Emphasis Type="Italic">EJIS</Emphasis> and <Emphasis Type="Italic">MISQ</Emphasis> between 1995 and 2008

This paper aims to shed light on the dynamics of information systems (IS) as a discipline in the making. We use the ideas of the sociologist Abbott to propose three different stages of a discipline's development: differentiation, competition, and absorption. These stages reflect how disciplines go through different cycles and how they acquire, consolidate or lose elements of knowledge. We map these stages using citation and co-citation analyses of two main IS academic journals (EJIS and MISQ) from 1995 to 2008. Our results indicate that IS is currently in a stage of absorption, with research being consolidated around the theme of ‘IS acceptance’. Dominant models and frameworks related to this theme are predictive and thus lend themselves usable for positivistic and quantitative research. In this stage there is also a healthy degree of variety in IS including dormant elements which could reignite. Implications derived from our findings aim to help in the consolidation and extension of knowledge about IS in both academia and practice.     

The research-practice relationship in ergonomics and human factors--surveying and bridging the gap

Significant discord has been aired regarding the widening research-practice gap in several disciplines (e.g. psychology, healthcare), especially with reference to research published in academic journals. The research-practice gap has profound and wide-ranging implications for the adequacy of ergonomics and human factors (E/HF) research and the implementation of research findings into practice. However, no substantive research on this issue has been identified in E/HF. Using an online questionnaire, practitioners were asked about their application of scientific research findings published in peer-reviewed journals and to suggest ways to improve research application in practice. A total of 587 usable responses were collected, spanning 46 countries. This article describes some of the key differences and correlations concerning reading, usefulness and barriers to application among respondents, who varied in terms of organisational type, percentage of work time devoted to application vs. research, society membership and experience. Various solutions proposed by the survey respondents on ways to bridge the research-practice gap are discussed. STATEMENT OF RELEVANCE: The relationship between research and practice in E/HF has long been a subject of discussion, with commentators pointing to tension and possible implications for the adequacy of the discipline. Findings from a cross-sectional survey provide ergonomics practitioners' views on research, leading to discussion of strategies for achieving better integration.     

Topics of interest in IS: evolution of themes and differences between research and practice

The information systems discipline has been criticized in the past for lack of secure foundations, frequent shifts in focus and lack of impact on practice. The study deals with two main issues—evolution of themes in IS research and practice over time and differences between research and practice in the IS area as evidenced by the publication process. More than 3000 articles published across five years in four IS journals and five magazines were examined and categorized by thematic areas. We find journals and magazines focusing on different themes with the former focusing on conceptual and abstract models while the latter devote attention to specific applications. Significantly, academic themes show more variance over time. Apparently, there is no significant increase in the richness of themes being addressed over time but there is evidence of conflicting contemporaneous trends in research and practice.     

Analyzing IS research productivity: an inclusive approach to global IS scholarship

An increasing number of studies have appeared that evaluate and rank journal quality and the productivity of IS scholars and their institutions. In this paper, we describe the results of one recent study identifying the ‘Top 30’ IS Researchers, revealing many unexamined assumptions about which IS publication outlets should be included in any definition of high-quality, scholarly IS journals. Drawing from the argument that all categories and classification schemes are grounded in politics, we critique the process by which the recent study in question (and several earlier studies) have derived the set of journals from which they count researcher publications. Based on a critical examination of the widespread inclusion of practitioner outlets, and the consistent exclusion of European scholarly IS journals, we develop our own arguments for which journals should be included in such evaluations of researcher productivity. We conduct our own analysis of IS researcher productivity for the period 1999–2003, based on articles published in a geographically balanced set of 12 IS journals, and then we compare our results with those from the recent study in question and their predecessors. Our results feature a more diverse set of scholars – both in terms of location (specifically, the country and continent in which the researchers are employed) and gender. We urge future studies of IS research productivity to follow our practice of including high-quality European journals, while eschewing practitioner-oriented publications (such as Harvard Business Review and Communications of the ACM). We also advocate that such studies count only research contributions (e.g., research articles), and that other genres of non-research articles – such as book reviews, ‘issues and opinions’ pieces and editorial introductions – not be conflated with counts of research contributions.     

Moden und Trends in Wirtschaftsinformatik und Information Systems

The business and information systems engineering (BISE) discipline, dominating in the German-speaking countries, where it is called Wirtschaftsinformatik, is currently undergoing a phase of increasing internationalization and the U.S.-based Information Systems (IS) discipline is often considered an ideal. Studies show that BISE has often dealt with fads in the past – for IS there are no findings reporting on the diffusion of fads. The objective of the paper is to close this research gap. We conducted a literature analysis that investigates the development of topics and terms in BISE and IS from 1994 to 2007. Titles, abstracts and keywords of 2,564 articles in three BISE journals and 5,647 articles in five IS journals were analyzed. The results show that BISE is topically more diverse and concrete than IS. In addition, the rate of fads is higher in BISE than IS. We concede that being engaged in fads is not necessarily negative – rather, it may considerably contribute to the relevance of research. However, it has to be considered that an overly intense orientation on fads may negatively influence a cumulative research progress. Hence, we conclude that for BISE and IS, which both have a theoretical and pragmatic mission, a balanced ratio of short- and long-term topics seems appropriate.     

Understanding the Philosophical Underpinnings of Software Engineering Research in Information Systems

The Information Systems (IS) discipline, and related research, focuses on the development, understanding, and use of technology to meet business needs. Technology, in particular software, is the basis for IS research, making software engineering a critical component of research in the IS domain. While the importance of software development is well accepted, what constitutes high quality software engineering research is not well defined. Perhaps this is because some software development clearly is not research and it is hard to distinguish between pure application development, and systems development that pushes the boundaries of knowledge. Sir Karl Popper argued that the scientific quality of research is not based on its empirical method, but on the nature of the questions asked. Our research suggests that software engineering can meet Popper's criteria for scientific research.Drawing on well-established research philosophies, we propose a software engineering research methodology (SERM) and discuss the utility of this methodology for contributing to and expanding the IS body of knowledge. We also describe the considerations that need to be addressed by SERM to enhance acceptability of software engineering research in IS. Our suggestions are corroborated with a review of current IS software engineering research reported in leading IS journals.     

Evolution of information systems research: Insights from topic modeling

Information systems (IS) research has continued to consistently evolve with the transitions in the IS discipline over time. There has been a general interest in the IS discipline over time as researchers have examined various aspects such as the intellectual core, diversity, and impact of IS research. On the basis of 2962 articles published in six leading IS journals between 2003 and 2017, topic modeling using latent semantic indexing was applied to author-supplied keywords. Topics such as IS development, IT adoption, and IS usage had endured over time; topics such as e-commerce and IT outsourcing had gained momentum and then waned over time; and topics such as social media, design science, and online communities have gained momentum in recent times. Results suggest that IS research has evolved considerably over time and generally included new frontiers while serving its core strength and identity.     

Research of information systems: from parochial to international,towards global or glocal?

The development over time of the Information Systems Journal and information systems (IS) research in general is examined by applying both quantitative and qualitative data analyses. The evidence suggests that the journal and the IS discipline have both evolved from parochial and national to become international. This evolution has influenced the phenomena and contexts being studied and, ultimately, theory and practice. Cultural and institutional differences are major obstacles to globalizing IS research. Based on a trilemma for theoretical development among generality, accuracy and simplicity, glocalization is suggested as an alternative to globalization. The merits of glocal research and education, with globally connected villages, are discussed.     

Reflections on information systems practice, education and research: 10 years of the Information Systems Journal

This paper celebrates the 10‐year anniversary of the Information Systems Journal (ISJ) and the Editors reflect on the papers that have been published over that period and the changes that have occurred in the discipline of information systems. In the opening paper of ISJ, we suggested that the ‘launch of a new journal in information systems prompts thought and debate concerning the state of the subject area and some contemplation of its past and future’. We discussed three areas of this ‘not‐yet‐established discipline’: practice, education and research. In this follow‐up paper, we forgo our convention of ISJ editors not publishing in the Journal. We examine the issues raised in the first paper and consider what has happened in the intervening years as charted in the ISJ. The overview is necessarily selective, probably Anglocentric (with, perhaps, a slight Francophile tinge), sometimes downright opinionated, as well as over‐estimating, perhaps, the contribution of one particular IS journal.     

Principles of canonical action research

Abstract.  Despite the growing prominence of canonical action research (CAR) in the information systems discipline, a paucity of methodological guidance continues to hamper those conducting and evaluating such studies. This article elicits a set of five principles and associated criteria to help assure both the rigor and the relevance of CAR in information systems. The first principle relates to the development of an agreement that facilitates collaboration between the action researcher and the client. The second principle is based upon a cyclical process model for action research that consists of five stages: diagnosis, planning, intervention, evaluation and reflection. Additional principles highlight the critical roles of theory, change through action, and the specification of learning in terms of implications for both research and practice. The five principles are illustrated through the analysis of one recently published CAR study.     

A profile of information systems research published in Information & Management

Information & Management (I&M) has been consistently regarded as one of the top academic journals in information systems (IS). In a spirit of introspection, this article profiles research published in I&M: we identified the most productive authors and universities associated with most research publications in I&M during the past 13 years (1992–2005). Based on a more detailed analysis of publications during the past 7 years, we determined the subject areas most often investigated and the research methodologies most often employed. Finally, we identified best practices by way of reporting the topics and methodologies used by the highly published authors. Our results indicate that while IS research is clearly dominated by US based universities, international researchers are beginning to make inroads. Furthermore, while the survey methodology is still dominant, interest in utilizing other methodologies is on the rise. Our findings should have implications for researchers, journal editors, universities, and research institutions.     

A paradigmatic and methodological examination of information systems research from 1991 to 2001

Abstract. The field of information systems (IS) has evolved for more than three decades. Although many schools of thought have emerged and even become well established, few historical analyses of research paradigms and methodologies have been undertaken. One of the rare exceptions is Orlikowski & Baroudi (1991). Yet, the IS research community has evolved substantially since 1991 in many aspects. A variety of journal outlets have emerged and become well established. More attention has been paid to paradigmatic and methodological issues. Political and professional contexts have also changed noticeably. Therefore, it should be an opportune time for the field to ask: ‘What changes are manifested in journal publications?’‘Is the field making progress regarding pluralism in IS research?’‘How will the field's publications practices change in the future?’ The purpose of this paper is to investigate these questions and, in turn, reflect on the paradigmatic and methodological progress made since 1991. We examined 1893 articles published in eight major IS publication outlets between 1991 and 2001. Our findings suggest that the long‐term endeavours of interpretivist researchers might need to continue because the paradigmatic progress appears somewhat inconsequential; positivist research still dominates 81% of published empirical research. In particular, US journals, as opposed to European journals, tend to be more positivist, quantitative, cross‐sectional and survey oriented. With respect to research design, survey research is still the most widely used method (41%), although case studies have gained substantial recognition (36%). Further, the increase of qualitative research (30%), empirical studies (61%) and longitudinal cases (33%) at the expense of laboratory experiments (18%) might suggest that IS researchers have become more interested in obtaining scientific knowledge in real world settings. In summary, we suggest that the field has been dominated by the positivist paradigm, despite calls to the contrary. Indeed, if the field was to truly embrace pluralism, it would have to find ways to fundamentally change the publication practices of the journal system, including the current tenure and promotion system, which pose considerable obstacles for the acceptance of alternative paradigms.     

Improving scale adaptation practices in information systems research: Development and validation of a cognitive validity assessment method

Scale adaptation, where authors alter the wording of an already published scale, is a deeply rooted social practice in IS research. This paper argues that the time is ripe to question this activity as well as the beliefs that have progressively formed around it. We identify and challenge five fallacious scale adaptation beliefs that hinder the development of more robust measure development norms. Contributing to this area of research, this paper offers a conceptual definition of the cognitive validity concept, defined as the extent to which a scale is free of problematic item characteristics (PICs) that bias the survey response process and subsequent empirical results. Building on this conceptualization effort, a new methodological process for assessing the cognitive validity of adapted IS measures is introduced. Through a series of three programmatic studies, we find converging evidence that the method can benefit the IS field by making the scale adaptation process more robust, transparent, and consistent. Along with the method, we introduce a new index that IS scholars can use to benchmark the cognitive quality of their scales against venerable IS measures. We discuss the implications of our work for IS research (including detailed implementation guidelines) and provide directions for future research on measurement in IS.     

Rethinking the place of the artefact in IS using Heidegger's analysis of equipment

The IT artefact, conceived as a bundle of features or properties, is frequently seen as the core object of interest in IS. We argue that this view of IT derives from a worldview that stresses a duality between the individual and the external world. Using a stylized account of an IT implementation project, we show how this worldview conditions the phenomena that show up as most central in the IS discipline and the way mainstream theories and research approaches make sense of these phenomena. Retelling the same story through the lens of Heidegger's analysis of equipment in Being and Time (1927/1962), we present an alternative conception of IT as equipment holistically interwoven with other equipment, user practices, and individual identities. This allows rethinking what are central and peripheral concepts and phenomena in the IS discipline, and outline implications of such a shift for IS theorising, research practice and design.     

Thematic orientation of the ISJ within a semantic space of IS research

This study examines research published in the first 24 years of Information Systems Journal's (ISJ) publication history using a thematic space of all information systems (IS) research as the backdrop. To that end, abstracts from all contributing articles published in eight prominent IS journals in the period 1991–2014 were analysed to extract a latent semantic space of five broad research areas. A two‐dimensional projection of the results was used to create a two‐by‐two map, where one dimension represents the European vs. North American style of IS research and another dimension represents a micro vs. macro level of IS research. The ISJ is positioned in the ‘micro and European school’ quadrant. Over the course of the journal's first 24 years, research in the ISJ started with a relative focus on the IT artefact and IS development and gradually moved towards a more balanced position that includes a considerable amount of research on IT for teamwork and collaboration, as well as on IT and individuals.