Doing critical information systems research – arguments for a critical research methodology

Critical information systems (IS) research, it is argued, does not have a distinct methodological identity. While some research methods are closely related to the positivist research paradigm (experiments, surveys, and structural equation modelling) and others to the interpretivist paradigm (field study, ethnography, and action research), the critical paradigm is not identified with specific ‘critical methods’ and typically relies on the appropriation of interpretivist methods (such as critical ethnography). The criticism of the critical research paradigm in IS has often focused on the lack of distinctly critical research methods and even the neglect of methodological issues (Klein; McGrath). This paper questions the notion of and the arguments behind the quest for ‘critical research methods’ defined in contrast to positivist and interpretivist methods. Instead, the paper argues that it is a critical research methodology – understood as an overall strategy of conceptualizing and conducting an inquiry, engaging with studied phenomena, and constructing and justifying socially relevant knowledge, which distinguishes critical from other research paradigms. Building on a Kleinian argument regarding the need for common principles across diverse critical IS inquiries (Klein; Myers & Klein) this paper proposes a framework that describes key dimensions of a critical research methodology that distinguish critical from other research paradigms and provide methodological guidance in the doing of critical research.     

A paradigmatic and methodological examination of information systems research from 1991 to 2001

Abstract. The field of information systems (IS) has evolved for more than three decades. Although many schools of thought have emerged and even become well established, few historical analyses of research paradigms and methodologies have been undertaken. One of the rare exceptions is Orlikowski & Baroudi (1991). Yet, the IS research community has evolved substantially since 1991 in many aspects. A variety of journal outlets have emerged and become well established. More attention has been paid to paradigmatic and methodological issues. Political and professional contexts have also changed noticeably. Therefore, it should be an opportune time for the field to ask: ‘What changes are manifested in journal publications?’‘Is the field making progress regarding pluralism in IS research?’‘How will the field's publications practices change in the future?’ The purpose of this paper is to investigate these questions and, in turn, reflect on the paradigmatic and methodological progress made since 1991. We examined 1893 articles published in eight major IS publication outlets between 1991 and 2001. Our findings suggest that the long‐term endeavours of interpretivist researchers might need to continue because the paradigmatic progress appears somewhat inconsequential; positivist research still dominates 81% of published empirical research. In particular, US journals, as opposed to European journals, tend to be more positivist, quantitative, cross‐sectional and survey oriented. With respect to research design, survey research is still the most widely used method (41%), although case studies have gained substantial recognition (36%). Further, the increase of qualitative research (30%), empirical studies (61%) and longitudinal cases (33%) at the expense of laboratory experiments (18%) might suggest that IS researchers have become more interested in obtaining scientific knowledge in real world settings. In summary, we suggest that the field has been dominated by the positivist paradigm, despite calls to the contrary. Indeed, if the field was to truly embrace pluralism, it would have to find ways to fundamentally change the publication practices of the journal system, including the current tenure and promotion system, which pose considerable obstacles for the acceptance of alternative paradigms.     

Information systems development as situated socio-technical change: a process approach

We outline a process approach for conducting qualitative research on how contemporary information systems (IS) development is enacted in practice. The approach involves a longitudinal case study to obtain rich data from which a detailed process narrative is produced. The narrative is informed by a conceptual model of IS development as situated socio-technical change, generating a theoretical explanation that highlights the temporal, emergent and contingent nature of IS development. This approach extends prior process studies of IS development by focusing on micro-level project activities, examining change as a continuous process and theorising IS change as the outcome of a dynamic trajectory of situated and socio-technical interactions. The methodological approach developed here can be used by other researchers to inform process studies of this complex organisational phenomenon.     

Explanation in Information Systems

Abstract.  Explanation of observed phenomena is a major objective of both those who conduct and those who apply research in information systems (IS). Whereas explanation based on the statistical relationship between independent and dependent variables is a common outcome of explanatory IS research, philosophers of science disagree about whether statistical relationships are the sole basis for the explanation of phenomena. The purpose of this paper is to introduce an expanded concept of explanation into the realm of IS research. We present a framework based on the four principle explanation types defined in modern philosophy: covering-law explanation, statistical-relevance explanation, contrast-class explanation and functional explanation. A well-established research stream, media richness, is used to illustrate how the different explanation types complement each other in increasing comprehension of the phenomenon. This framework underlies our argument that explanatory pluralism can be used to broaden research perspectives and increase scientific comprehension of IS phenomena above and beyond the methodological and ontological pluralism currently in use in IS research.     

Characteristics of IT artifacts: a systems thinking‐based framework for delineating and theorizing IT artifacts

The information technology artifact (ITA) has been suggested as the core of information systems (IS) research, and the research community has been encouraged to deeply engage with the ITA. Various studies highlight, however, that the ITA continues to receive only limited attention and thus, little foundation exists for IS researchers to delineate and theorize about the ITAs studied. In this paper, we develop a framework that can be utilized as a language for articulating and theorizing the ITA in IS research. Our framework builds on the multi‐faceted theoretical paradigm of systems thinking from which we derive several concepts and appropriate them to the context at hand, resulting in a seven‐dimensional framework of characteristics for ITAs. In a literature survey of research on enterprise systems and enterprise resource planning systems in top IS journals, we show how ITA characteristics are currently included to present details of the relevant ITA instance and identify theoretical relationships between ITA characteristics and outcomes. We conclude the study by demonstrating the use of the ITA framework for delineating and theorizing the ITA in IS research.     

Information systems action research: Debunking myths and overcoming barriers

The relevance of action research as a research method in the information systems (IS) discipline is not disputed. Nevertheless, the extent to which action research is published in good journals is infrequent enough to indicate a serious problem. In this article, we explore the reasons underlying this situation and make recommendations aiming to increase both the practice and the publication of action research. To identify both the barriers to undertaking action research and potential ways of overcoming those barriers, we survey 218 authors of 120 articles demonstrating empirical action research published in 12 of our good journals during the period 1982–2016. We received 70 usable responses. We also surveyed 52 editors of selected IS journals and received 25 usable responses. Our findings are revealing as they indicate both genuine barriers associated with action research and some apparent barriers that are in reality misperceptions or myths. In reflecting on these, we emphasize the special qualities of action research. We also reflect on the critical role that action research plays in the IS field as a whole and its potential for further contributions to research and practice, given the strong and close connections with organizational problem contexts that action research requires. Finally, we make a number of recommendations that are designed to increase the incidence of action research in the IS discipline     

Immersive virtual reality in the age of the Metaverse: A hybrid-narrative review based on the technology affordance perspective

Immersive virtual reality (VR) that utilizes head-mounted displays (HMD) is one of the key emerging technologies of the 21st century and has drawn keen attention from consumers, practitioners, and scholars in various disciplines. Nevertheless, the information systems (IS) discipline has neglected immersive VR, given that only a handful of studies have been published in mainstream IS journals. However, the recent advancements in immersive VR technology provide new opportunities for organizations and IS researchers. In light of these points, we reviewed the immersive VR literature to provide a holistic view of opportunities and challenges for organizations and future research directions for the IS field. By examining the technical capabilities of immersive VR and the previous literature, we identified five affordances: embodiment, interactivity, navigability, sense-ability, and create-ability. Our review of the 151 studies from the IS and related fields synthesized how these affordances were utilized in various research domains. Guided by the affordance-actualization theory, we also identified the strategic opportunities and challenges that come with implementing VR. The actualization of immersive VR affordances in organizations is indeed a fruitful area for IS scholars as there are various venues to move the IS field as well as the VR research in the organizational context forward.     

Enabling a Kleinian integration of interpretivist and socio-critical IS research: the contribution of Dooyeweerd's philosophy

This paper suggests how interpretivist, socio-critical and positivist approaches in information systems (IS) research might be integrated. Heinz Klein's approach to IS was a significant advance on earlier ones, bringing together a number of issues discussed in interpretivist and socio-critical circles, with philosophical groundings. He believed IS research would benefit from integration of interpretivist and socio-critical approaches, but found no philosophical grounding for this. Interpretivism's reluctance to consider normativity might be a ‘Trojan horse’ that undermines integration. This paper employs Dooyeweerd's philosophy to expose and expel the Trojan horse and sketch how a philosophically grounded integration of interpretivist, socio-critical and even positivist approaches might proceed.     

Rethinking the concept of the IS organization

Do conceptualizations of the information systems (IS) organization reflect findings from research studying requirements for successfully harnessing information, systems and technology to achieve operational and strategic objectives? This paper addresses this question, reporting on an analysis of articles published in leading academic and practitioner journals. It describes how the IS organization is portrayed in these studies and examines the results of this analysis through a sensitizing lens constructed from research that has studied how organizations generate business value from IS. The lens depicts this objective as a quest to harness knowledge that is distributed enterprise wide. The analysis suggests that conceptualisations of the IS organization used by researchers do not reflect the requirements for generating business value from information technology that have been identified in the literature. Whilst highlighting that definitions are vague or more often absent, it challenges the dominant orthodoxy of the IS organization as a separate organizational unit suggesting that it is a more pervasive construct. The implications of this conclusion for practice, research and teaching are considered.     

Forschungsmethoden der Wirtschaftsinformatik

The german-speaking IS community sees itself as a methodological pluralist discipline. With respect to recent debates (e.g. on rigor versus relevance) an exact knowledge of its methodological profile becomes increasingly important. This contribution presents the findings of a content analysis of 300 articles published in the journal WIRTSCHAFTSINFORMATIK in the last ten years. As one result, the study identified six major methods of the german-speaking IS community: argumentative, conceptional and formal deductive research, prototyping, case studies and quantitative cross sectional studies. It could also be shown, that the methodological profile continually changed during the last ten years. The article also compares its findings with the current methodological profile of the anglo-american IS community based on a secondary data analysis.     

A storyteller's guide to problem‐based learning for information systems management education

More than a decade ago, evidence‐based recommendations emerged regarding what students of information systems (IS) management education should learn and how should they learn it. Although these recommendations for how IS management should be taught remain valid, they need to be updated to account for recent advances in technologies that enable multimedia learning. Promoters of such technologies promise enhanced cognitive and behavioural outcomes, but this promise remains unreached, reflecting the underdeveloped multimedia‐enabled learning literature. To help attain this promise and rejuvenate the literature of multimedia learning, we offer a roadmap for new areas of research that would inform the design and use of a novel form of multimedia materials: narrative animated videos (NAVs). NAVs represent a form of self‐determined learning that features immersive, story‐based content. We argue that their use will intrinsically motivate users to process the materials to completion, thereby enhancing cognitive and behavioural outcomes, and thus catalysing the effectiveness of the team‐based learning and self‐regulated learning modes for problem‐based learning (PBL) delivery of IS management education. This compelling roadmap corresponds to meaningful IS research because it centres on a topic that the IS literature has long examined—the role of user motivation—and because its theoretical contributions invite specific paths of research for informing the design of the PBL delivery of IS management education within an information systems artefact.     

Information systems use as strategy practice: A multi-dimensional view of strategic information system implementation and use

Information systems (IS) are strategic in so far as they are used to realize strategic intent. Yet, while much has been said about aligning IS functionality with the strategic intent and how to organizationally implement strategically aligned systems, less is known of how to successfully implement strategic change associated with system use – a truly critical challenge within strategic IS implementation. Drawing on a strategy-as-practice perspective we address this gap by developing a multi-dimensional view of IS strategy, conceptualizing three key challenges in the IS strategy process, to explain how and why a paper mill, despite successfully implementing a strategic production management system, failed to produce intended strategic change. We call this outcome strategy blindness: organizational incapability to realize the strategic intent of implemented, available system capabilities. Using a longitudinal case study we investigate how cognitive rigidity of key actors and fixed, interrelated practices shaped the implementation of the new production system. We also identify core components and dynamics that constitute a richer multi-dimensional view of the IS strategy implementation (alignment) process. In particular, we identify three salient factors that contribute to strategy blindness – mistranslation of intent, flexibility of the IT artifact and cognitive entrenchment – and discuss how they affect strategic implementation processes. We conclude by discussing implications of our findings for IS strategy theory and practice, especially the contribution of strategy-as-practice to this stream of research.     

Reconsidering deconstruction in information systems research

Deconstruction, a post-structuralist approach to examining language in texts, is most often associated with the philosophical works of Jacque Derrida. After a flurry of interest among management and information systems (IS) scholars, this qualitative approach to exploring organizational texts has received little attention in the IS literature. We suggest deconstruction could help our field explore how IS texts describe the social and technical past and also prescribe and circumscribe the future of IS practice. Thus, we suggest the IS field reconsider how deconstruction might contribute to language-based approaches in IS research and practice. In this paper, we discuss deconstruction in light of the linguistic turn in social science research and the support and criticism for its use in management research. We consider IS research publications that have employed deconstruction explicitly, examine a well-known IS publication as an example of the deconstruction of IS texts, and suggest ways in which deconstruction might be applied to various genres of IS texts to inspire insights and creativity. To conclude, we highlight considerations for researchers who might adopt this approach and for the editors and reviewers who would evaluate qualitative research papers that employ deconstruction.     

Pluralist action research: a review of the information systems literature*

Action research (AR) has for many years been promoted and practised as one way to conduct field studies within the information systems (IS) discipline. Based on a review of articles published in leading journals, we explore how IS researchers practise AR. Our review suggests that AR lends itself strongly towards pluralist approaches which facilitate the production of both theoretical and practical knowledge. First, on the level of each study we analyse how research and problem‐solving activities are mixed, in three ways: the research dominant, the problem‐solving dominant and the interactive approaches. Second, in the context of the wider research programme in which the study is situated, we analyse how AR is mixed with other research methods, in two ways: the dominant and the sequential approaches. We argue that these pluralist practices of mixing types of research activities and types of research methods provide IS action researchers with a rich portfolio of approaches to knowledge production. This portfolio helps them address the risks involved in AR to ensure their efforts contribute to the literature as well as to practical problem‐solving.     

The property of being causal – The conduct of qualitative comparative analysis in information systems research

Grounded in configuration and complexity theory, qualitative comparative analysis (QCA) combines the advantages of case-based and variable-oriented methods for rendering complex information systems (IS) phenomena comprehensible. Given its manifold benefits, the QCA method has attracted considerable attention in IS research, with an increasing number of studies employing it as their methodological approach. Based on a comprehensive review and synthesis of recent QCA practices from the IS field, covering 12 years of research, we outline the most prevalent research gaps and limitations concerning QCA's methodological application prior to identifying issues for further improvement as well as highlighting future research directions.     

Measuring value dimensions of IT occupational culture: an exploratory analysis

Culture in information systems (IS) research has been an important area of study for over twenty-five years but has focused on two levels of analysis: national and organizational. However, research at the level of IT occupational culture has been minimal. Shared values are the core element of any cultural group and the IS literature has repeatedly called for measurable dimensions of IT culture. This study is an exploratory positivist investigation into scale creation and proposes a set of six value dimensions specific to the context of IT occupational culture based on a review of the relevant IS literature culture as well as interviews with IT professionals. These six dimensions are: Structure of Power, Control, Open Communication, Risk, Reverence for Knowledge, and Enjoyment (abbreviated as SCORRE). A preliminary instrument was prepared and tested with an empirical study. The instrument was found to have both high reliability and construct validity and is ready for further use in ongoing research. There was further evidence that SCORRE represents many core values that form the foundation of IT occupational culture.     

A study of IS assets,IS ambidexterity,and IS alignment: the dynamic managerial capability perspective

This study aims to explore how IT-business alignment can be better achieved. Drawing on the dynamic capability view, information systems (IS) alignment and IS ambidexterity are theorized as IT departments’ ordinary capability and dynamic managerial capability, respectively. Four IS assets are identified as antecedents of both IS ambidexterity and IS alignment. A research model with 14 hypotheses is tested with a sample of 162 manufacturing firms. The PLS analysis shows that IS ambidexterity can increase IS alignment in terms of operational support and that the four IS assets can affect IS alignment directly or indirectly. Implications for research and practice are provided.     

CASE tools and organizational action

Abstract. CASE research to date has been dominated by positivistic enquiry; particularly tool building, surveys and normative writings. In contrast, there is a growing community of IS researchers developing models of IS practice that highlight the complex relationship between context and process that has to be mastered in order to develop viable information systems. This paper bridges the gap between the two bodies of knowledge by presenting a phenomenological study of CASE tool usage in a large UK manufacturing company over a four year period which shows that organizational context, tool features and usage are inextricably linked. The lessons arising from the work are presented and grounded in interpretive IS theory. The results of the work are clearly in accord with this theory, thus, showing the importance of interpretive CASE research, as a complement to positivist thinking, in bringing to light the human and organizational issues which strongly influence systems development practice     

Conceptualizing models using multidimensional constructs: a review and guidelines for their use

While information on multidimensional constructs and empirical methods has become more accessible, there remain substantial challenges to theorizing about their form and implications. There are at least two ostensible reasons for such difficulties. First is the issue of terminology; many different terms are currently used to represent the same structural concept, and there is no evidence of standardization taking place around a single set of terms. Second, many studies do not clearly explain the theoretical reasons for choosing the specific multidimensional form of their constructs. To address these deficiencies, we use concepts from the research methods literature, and illustrations from the information systems (IS) literature, to review definitions and issues related to conceptualizing and operationalizing structural models that include multidimensional constructs. Such advice is necessary if we are going to develop and test increasingly sophisticated theoretical models in IS research. We also offer guidelines about how to conceptualize specific forms of multidimensional constructs. By lending greater conceptual clarity to the literature, we believe that this paper provides a foundation for future research incorporating multidimensional constructs in empirical analysis.     

Improving scale adaptation practices in information systems research: Development and validation of a cognitive validity assessment method

Scale adaptation, where authors alter the wording of an already published scale, is a deeply rooted social practice in IS research. This paper argues that the time is ripe to question this activity as well as the beliefs that have progressively formed around it. We identify and challenge five fallacious scale adaptation beliefs that hinder the development of more robust measure development norms. Contributing to this area of research, this paper offers a conceptual definition of the cognitive validity concept, defined as the extent to which a scale is free of problematic item characteristics (PICs) that bias the survey response process and subsequent empirical results. Building on this conceptualization effort, a new methodological process for assessing the cognitive validity of adapted IS measures is introduced. Through a series of three programmatic studies, we find converging evidence that the method can benefit the IS field by making the scale adaptation process more robust, transparent, and consistent. Along with the method, we introduce a new index that IS scholars can use to benchmark the cognitive quality of their scales against venerable IS measures. We discuss the implications of our work for IS research (including detailed implementation guidelines) and provide directions for future research on measurement in IS.