Der Stand der Forschung zur Erfolgsmessung von Informationssystemen

Measuring information systems (IS) success is of great interest to both researchers and practitioners. This article examines multidimensional approaches to measuring IS success and explores the current state of IS success research through a literature review and by classifying articles published between 2003 and 2007. Based on a total of 41 academic journal and conference publications, the relevant research carried out is identified, while the research results are categorized, consolidated, and discussed. The results show that the dominant empirical research analyzes the individual impact of a certain type of information system by ascertaining users’ evaluation of it by means of surveys and then applying structural equation modeling. The DeLone and McLean Information Systems Success Model is the main theoretical basis of the reviewed empirical studies. This article provides researchers with a comprehensive review and structuring of IS success research. Furthermore, opportunities for additional development are identified and future research directions suggested.     

Measuring information systems success: models,dimensions, measures,and interrelationships

Since DeLone and McLean (D&M) developed their model of IS success, there has been much research on the topic of success as well as extensions and tests of their model. Using the technique of a qualitative literature review, this research reviews 180 papers found in the academic literature for the period 1992–2007 dealing with some aspect of IS success. Using the six dimensions of the D&M model – system quality, information quality, service quality, use, user satisfaction, and net benefits – 90 empirical studies were examined and the results summarized. Measures for the six success constructs are described and 15 pairwise associations between the success constructs are analyzed. This work builds on the prior research related to IS success by summarizing the measures applied to the evaluation of IS success and by examining the relationships that comprise the D&M IS success model in both individual and organizational contexts.     

Assessing e‐commerce systems success: a respecification and validation of the DeLone and McLean model of IS success

Abstract. DeLone & McLean (2003) propose an updated information systems (IS) success model and suggest that it can be extended to investigating e‐commerce systems success. However, the updated IS success model has not been empirically validated in the context of e‐commerce. Further, the existing IS/e‐commerce success models have been subject to considerable debate on the ‘IS Use’ and ‘Perceived Usefulness’ constructs, and the nomological structure of the updated DeLone and McLean model is somewhat inconsistent with the IS acceptance and marketing literature. Based on the IS and marketing literature, this paper respecifies and validates a multidimensional model for assessing e‐commerce systems success. The validated model consists of six dimensions: Information Quality, System Quality, Service Quality, Perceived Value, User Satisfaction and Intention to Reuse. Structural equation modelling techniques were applied to data collected by questionnaire from 240 users of e‐commerce systems in Taiwan. The empirical evidence suggests that Intention to Reuse is affected by Perceived Value and User Satisfaction, which, in turn, are influenced by Information Quality, System Quality and Service Quality. The nomological structure of the respecified e‐commerce systems success model is concurred with that of the technology acceptance model (TAM) in the IS field and the consumer behaviour models in the traditional business‐to‐business and retail contexts. The findings of this study provide several important implications for research and practice. This paper concludes by discussing the contributions of this study and the limitations that could be addressed in future studies.     

A chronological review of empirical research on personal information privacy concerns: An analysis of contexts and research constructs

As concerns about personal information privacy (PIP) continue to grow, an increasing number of studies have empirically investigated the phenomenon. However, researchers are not well informed about the shift of PIP research trends with time. In particular, there is a lack of understanding of what constructs have been studied in what contexts. As a result, researchers may design their study without sufficient guidance. This problem can lead to unproductive efforts in advancing PIP research. Therefore, it is important and timely to review prior PIP research to enhance our understanding of how it has evolved. We are particularly interested in understanding the chronological changes in contexts and research constructs studied. We use a chronological stage model of PIP research we develop, a set of contextual variables identified from prior literature, and the four-party PIP model suggested by Conger et al. (2013) as theoretical foundations to conduct a chronological literature review of empirical PIP concern studies. We find several PIP research trends during the last two decades, such as the quantity of PIP research has drastically increased; the variety of contexts and research constructs being studied has increased substantially; and many constructs have been studied only once while only a few have been repeatedly studied. We also find that the focus of PIP research has shifted from general/unspecified contexts to specific ones. We discuss the contributions of the study and recommendations for future research directions. We propose a fifth party as an emergent player in the ecosystem of PIP and call for future research that investigates it.     

Using information-systems constructs to study online- and telephone-banking technologies

The research literature has seen a number of studies aimed at understanding customer attitudes towards banking technologies, and thereby providing implications for developmental planning and marketing. However, even though banking technologies have a significant amount of information systems (IS) component to them, there is a paucity of research that considers them from the IS perspective. In this paper, we fill this gap by considering three constructs, namely usefulness, ease of use and usage, that are all rooted in the IS literature. We study user’s perceptions of these constructs, as well as the relationships among them, for both online and telephone banking.     

Using information-systems constructs to study online- and telephone-banking technologies

The research literature has seen a number of studies aimed at understanding customer attitudes towards banking technologies, and thereby providing implications for developmental planning and marketing. However, even though banking technologies have a significant amount of information systems (IS) component to them, there is a paucity of research that considers them from the IS perspective. In this paper, we fill this gap by considering three constructs, namely usefulness, ease of use and usage, that are all rooted in the IS literature. We study user’s perceptions of these constructs, as well as the relationships among them, for both online and telephone banking.     

Human error and information systems failure: the case of the London ambulance service computer-aided despatch system project

Human error and systems failure have been two constructs that have become linked in many contexts. In this paper we particularly focus on the issue of failure in relation to that group of software systems known as information systems. We first review the extant theoretical and empirical work on this topic. Then we discuss one particular well-known case — that of the London ambulance service computer-aided despatch system (L ) project — and use it as a particularly cogent example of the features of information systems failure. We maintain that the tendency to analyse information systems failure solely from a technological standpoint is limiting, that the nature of information systems failure is multi-faceted, and hence cannot be adequately understood purely in terms of the immediate problems of systems construction. Our purpose is also to use the generic material on IS failure and the specific details of this particular case study to critique the issues of safety, criticality, human error and risk in relation to systems not currently well considered in relation to these areas.     

Designing business model taxonomies – synthesis and guidance from information systems research

Classification is an essential approach in business model research. Empirical classifications, termed taxonomies, are widespread in and beyond Information Systems (IS) and enjoy high popularity as both stand-alone artifacts and the foundation for further application. In this article, we focus on the study of empirical business model taxonomies for two reasons. Firstly, as these taxonomies serve as a tool to store empirical data about business models, we investigate their coverage of different industries and technologies. Secondly, as they are emerging artifacts in IS research, we aim to strengthen rigor in their design by illustrating essential design dimensions and characteristics. In doing this, we contribute to research and practice by synthesizing the diffusion of business model taxonomies that helps to draw on the available body of empirical knowledge and providing artifact-specific guidance for building taxonomies in the context of business models.

     

An assessment of the use of Transaction Cost Theory in information technology outsourcing

Transaction Cost Theory (TCT) has been widely used in information technology outsourcing (ITO) research to explain and predict outsourcing decisions and outsourcing-related outcomes. This research, however, has led to mixed and unexpected results in terms of the effects of transaction attributes on outsourcing decisions and outcomes. This study assesses the empirical literature employing TCT-based ITO models in terms of its faithfulness to the precepts of TCT, and argues that one possible explanation for the mixed results is that the extant models do not capture all the essential elements of TCT. First, there are core TCT constructs that the extant models do not take into account; second, the linkages among constructs that the IT outsourcing models have hypothesized are not always in line with TCT precepts; and third, the normative nature of the theory is not always captured by the extant models. This paper, therefore, aims to provide one possible answer to the question: “Why have the appropriations made of TCT to study IT outsourcing produced mixed results?”     

Measuring value dimensions of IT occupational culture: an exploratory analysis

Culture in information systems (IS) research has been an important area of study for over twenty-five years but has focused on two levels of analysis: national and organizational. However, research at the level of IT occupational culture has been minimal. Shared values are the core element of any cultural group and the IS literature has repeatedly called for measurable dimensions of IT culture. This study is an exploratory positivist investigation into scale creation and proposes a set of six value dimensions specific to the context of IT occupational culture based on a review of the relevant IS literature culture as well as interviews with IT professionals. These six dimensions are: Structure of Power, Control, Open Communication, Risk, Reverence for Knowledge, and Enjoyment (abbreviated as SCORRE). A preliminary instrument was prepared and tested with an empirical study. The instrument was found to have both high reliability and construct validity and is ready for further use in ongoing research. There was further evidence that SCORRE represents many core values that form the foundation of IT occupational culture.     

Organizational impact of system quality,information quality,and service quality

Increased organizational dependence on information systems drives management attention towards improving information systems’ quality. A recent survey shows that “Improve IT quality” is one of the top concerns facing IT executives. As IT quality is a multidimensional measure, it is important to determine what aspects of IT quality are critical to organizations to help Chief Information Officers (CIOs) to devise effective IT quality improvement strategies. In this research, we model the relationship between information systems’ (IS) quality and organizational impact. We hypothesize greater organizational impact in situations in which system quality, information quality and service quality are high. We also hypothesize a positive relationship between system quality and information quality. We test our hypotheses using survey data. Our structural equation model exhibits a good fit with the observed data. Our results show that IS service quality is the most influential variable in this model (followed by information quality and system quality), thus highlighting the importance of IS service quality for organizational performance. This paper contributes theoretically to IS success models through the system quality-to-information quality and IS quality-to-organizational impact links. Implications of our results for practice and research are discussed.     

A storyteller's guide to problem‐based learning for information systems management education

More than a decade ago, evidence‐based recommendations emerged regarding what students of information systems (IS) management education should learn and how should they learn it. Although these recommendations for how IS management should be taught remain valid, they need to be updated to account for recent advances in technologies that enable multimedia learning. Promoters of such technologies promise enhanced cognitive and behavioural outcomes, but this promise remains unreached, reflecting the underdeveloped multimedia‐enabled learning literature. To help attain this promise and rejuvenate the literature of multimedia learning, we offer a roadmap for new areas of research that would inform the design and use of a novel form of multimedia materials: narrative animated videos (NAVs). NAVs represent a form of self‐determined learning that features immersive, story‐based content. We argue that their use will intrinsically motivate users to process the materials to completion, thereby enhancing cognitive and behavioural outcomes, and thus catalysing the effectiveness of the team‐based learning and self‐regulated learning modes for problem‐based learning (PBL) delivery of IS management education. This compelling roadmap corresponds to meaningful IS research because it centres on a topic that the IS literature has long examined—the role of user motivation—and because its theoretical contributions invite specific paths of research for informing the design of the PBL delivery of IS management education within an information systems artefact.     

The DySIIM model for managing IS integration in mergers and acquisitions

Corporate mergers and acquisitions (M&As) are prominent means for corporate strategy. In many M&As information systems (IS), integration is critical for achieving the intended goals. By integrating previous research on M&A and IS integration, we develop a six‐dimensional theoretical framework for IS integration in corporate M&As. The framework is used to describe and explain IS integration management in four M&As. Based on the four cases, the theoretical framework and the existing literature, an initial model (Dynamic System of IS Integration in M&A, DySIIM) describing and explaining how IS integration relates to the M&A process is developed. Through the combination of the DySIIM's dimensions, the dynamics of different parts of the M&A process are captured. The model can be used in further research to build cumulative knowledge about how to manage IS integration in M&A. The model can also be used by companies in their M&A since through the combination of dimensions, it shows the IS integration issues, decisions and actions that a company has to address in the process.     

Pluralist action research: a review of the information systems literature*

Action research (AR) has for many years been promoted and practised as one way to conduct field studies within the information systems (IS) discipline. Based on a review of articles published in leading journals, we explore how IS researchers practise AR. Our review suggests that AR lends itself strongly towards pluralist approaches which facilitate the production of both theoretical and practical knowledge. First, on the level of each study we analyse how research and problem‐solving activities are mixed, in three ways: the research dominant, the problem‐solving dominant and the interactive approaches. Second, in the context of the wider research programme in which the study is situated, we analyse how AR is mixed with other research methods, in two ways: the dominant and the sequential approaches. We argue that these pluralist practices of mixing types of research activities and types of research methods provide IS action researchers with a rich portfolio of approaches to knowledge production. This portfolio helps them address the risks involved in AR to ensure their efforts contribute to the literature as well as to practical problem‐solving.     

IS outsourcing management competence dimensions: instrument development and relationship exploration

In this paper, we discuss our investigation of IS outsourcing management competences, their relationships and measurement. First, three theoretical perspectives were applied to explain the nature of the IS outsourcing phenomenon. Second, IS outsourcing management competence dimensions and their measures were generated, based on the literature. Third, data was then gathered to refine measures empirically and test proposed competences and their relationships. The theoretical development and empirical testing filled the gap in IS outsourcing management competence research resulting in important implications for IS outsourcing practitioners.     

Towards the improved treatment of generalization of knowledge claims in IS research: drawing general conclusions from samples

This paper presents a framework for justifying generalization in information systems (IS) research. First, using evidence from an analysis of two leading IS journals, we show that the treatment of generalization in many empirical papers in leading IS research journals is unsatisfactory. Many quantitative studies need clearer definition of populations and more discussion of the extent to which ‘significant’ statistics and use of non-probability sampling affect support for their knowledge claims. Many qualitative studies need more discussion of boundary conditions for their sample-based general knowledge claims. Second, the proposed new framework is presented. It defines eight alternative logical pathways for justifying generalizations in IS research. Three key concepts underpinning the framework are the need for researcher judgment when making any claim about the likely truth of sample-based knowledge claims in other settings; the importance of sample representativeness and its assessment in terms of the knowledge claim of interest; and the desirability of integrating a study's general knowledge claims with those from prior research. Finally, we show how the framework may be applied by researchers and reviewers. Observing the pathways in the framework has potential to improve both research rigour and practical relevance for IS research.     

Characteristics of IT artifacts: a systems thinking‐based framework for delineating and theorizing IT artifacts

The information technology artifact (ITA) has been suggested as the core of information systems (IS) research, and the research community has been encouraged to deeply engage with the ITA. Various studies highlight, however, that the ITA continues to receive only limited attention and thus, little foundation exists for IS researchers to delineate and theorize about the ITAs studied. In this paper, we develop a framework that can be utilized as a language for articulating and theorizing the ITA in IS research. Our framework builds on the multi‐faceted theoretical paradigm of systems thinking from which we derive several concepts and appropriate them to the context at hand, resulting in a seven‐dimensional framework of characteristics for ITAs. In a literature survey of research on enterprise systems and enterprise resource planning systems in top IS journals, we show how ITA characteristics are currently included to present details of the relevant ITA instance and identify theoretical relationships between ITA characteristics and outcomes. We conclude the study by demonstrating the use of the ITA framework for delineating and theorizing the ITA in IS research.     

The paucity of multimethod research: a review of the information systems literature

Abstract.  It has commonly been argued that the use of different research methods within the information system (IS) discipline and within individual pieces of research will produce richer and more reliable results. This paper reports on a survey of the IS literature to discover the extent of multimethod research. The findings are that such work is relatively scarce, and where it occurs involves only a small set of traditional methods. Possible reasons for this are discussed.     

A review of the factors which influence the use and usefulness of information systems

The potential usefulness of different kinds of Information System (IS) for environmental management is well recognised. However, concerns have been raised about the translation of this potential into actual use and benefit to policy and planning organisations and outcomes. The aims of this paper are to identify those factors which have been found to influence the use and usefulness of IS and in doing so to provide advice for managing development and implementation processes. There is no body of empirical work on the topic for environmental application. However a substantial literature on non-environmental IS has been developed and is used as source material. A classification of IS life cycle processes is developed and the best, worst and possible predicting factors for each process identified. The best predicting factors for IS usefulness across the life cycle were found to be user participation, user perceptions and intentions, user computer experience, top management support, support and training, external pressure, IS unit professionalism and the availability of external information sources. The state of knowledge about the determinants of IS usefulness is discussed and priorities for future research are identified. The factors identified are then discussed in terms of what they mean for managing IS development and for overcoming concerns about environmental IS development and use.     

Effects of organizational context and inter-group behaviour on the success of strategic information systems planning: an empirical study

The strategic value of information systems (IS) and the impact of information technology (IT) on business competitiveness has increased the need for effective strategic information systems planning (SISP). However, numerous strategic information systems planning methodologies stress the rational and formal aspects of organizational life, while ignoring the complexity of actual organizational situations which are characterized by human behaviour. Additionally, although numerous researchers have conducted empirical studies examining the relationship between various factors and strategic IS planning effectiveness, many factors have received little attention. This study uses structural equation modeling (SEM) to analyse the effects of organizational context and inter-group behaviour on the success of SISP. A survey of senior IS executives in Taiwan was used to test the relationships between the constructs in the research model. The results showed that certain factors relating to organizational context and inter-group behaviour influenced the success of SISP. Finally, the implications of this finding for IS practice and future research are examined.