Linking employees’ e-learning system use to their overall job outcomes: An empirical study based on the IS success model

e-Learning systems are increasingly being adopted by modern enterprises, because of their cost-down effect. However, the extant literature provides little insight into their beneficial consequences. It is expected that a transfer of acquired knowledge, skills and/or work attitudes to jobs will occur through e-learning systems use. This makes e-learning systems a useful tool for improving job outcomes, although this is not well documented. The IS success model, which captures both the human and technological elements of information systems, provides a theoretical basis for linking system use to system task. The current study then examines the relation between e-learning systems use and overall job outcomes based on the model. The data collected from one hundred and ninety-three e-learning system users were analyzed with partial least square (PLS). The results indicate that e-learning systems are perceived as useful and satisfying by employees, and employees’ e-learning systems use is significantly associated with overall job outcomes. In practice, these results provide a basis for establishing a link between an organization’s investment in e-learning and human capital management. They also lend empirical support to the IS success model.     

Clarifying the empirical connection of new entrants’ e-learning systems use to their job adaptation and their use patterns under the collective-individual training environment

In recent years, with the development of e-learning, it is feasible for enterprises to adopt information systems to enhance organizations’ human capital and knowledge renewal for competition. e-Learning systems designed for new entrants training aim to facilitate new entrants’ job adaptation; however, the empirical link between their system use and job adaptation lacks. In addition, the influence of environmental variables on new entrants’ e-learning training still needs clarification. Thus, based on the theoretical framework of the IS (information system) success model, this study is motivated to make an empirical connection of new entrants’ e-learning systems use to their job adaptation, including organizational socialization and overall job-adaptation outcome, and also to clarify their system use patterns under different collective-individual socialization training environments. Data from one hundred and eighty-six valid respondents who entered their organizations within a year were gathered and analyzed with PLS (partial least square). The results suggested the valid connection of new entrants’ e-learning systems use to their organizational socialization and overall job-adaptation outcome. New entrants also presented partially different system use patterns for adaptation under the different human interaction environments. The findings facilitated the design of training programs for new entrants at the e-learning environment.     

Measuring e-learning systems success in an organizational context: Scale development and validation

Electronic learning (e-learning) has been widely adopted as a promising solution by many companies to offer learning-on-demand opportunities to individual employees in order to reduce training time and cost. While information systems (IS) success models have received much attention among researchers, little research has been conducted to assess the success and/or effectiveness of e-learning systems in an organizational context. Whether traditional IS success models can be extended to investigate e-learning systems success has been scarcely addressed. Based on previous IS success literature, this study developed and validated a multi-dimensional model for assessing e-learning systems success (ELSS) from the perspective of the employee (e-learner). The procedures used in conceptualizing an ELSS construct, generating items, collecting data, and validating a multiple-item scale for measuring ELSS are described. This paper presents evidence of the scale’s factor structure, reliability, content validity, criterion-related validity, convergent validity, and discriminant validity on the basis of analyzing data from a sample of 206 respondents. Theoretical and managerial implications of our results are discussed. This empirically validated instrument will be useful to researchers in developing and testing e-learning systems theories, as well as to organizations in implementing successful e-learning systems.     

The effects of organizational learning environment factors on e-learning acceptance

Workplace learning is an important means of employees’ continuous learning and professional development. E-learning is being recognized as an important supportive practice for learning at work. Current research on the success factors of e-learning in the workplace has emphasized on employees’ characteristics, technological attributes, and training design elements, with little attention to workplace contextual effects. The study aims to investigate the impacts of organizational learning environment factors, including managerial support, job support, and organizational support, on employees’ motivation to use a workplace e-learning system. A model was proposed based on the expectancy theory of training motivation and the social influences and facilitating conditions in technology acceptance models. The model was tested on sample data collected from mainland China using Structural Equation Modeling and Moderated Structural Equation Modeling. The results suggested that employees’ perceived managerial support and job support had a significant impact on their perceived usefulness of the e-learning system for individual learning, and that perceived organizational support had a significant influence on the perceived usefulness of the e-learning system for social learning. Perceived usefulness for individual learning was found to completely mediate the environmental influences on individuals’ motivation to use the system, while perceived usefulness for social learning made partial mediation in the effects of the environmental factors on intention to use. In addition, perceived job support was found to have moderating effects on the relationship between employees’ perceived usefulness of the e-learning system and their intention to use the system. Consistent with previous findings, employees’ perceptions about the usefulness of the e-learning system have significant effects on their intention to use the system in the work setting.     

Assessing e-learning 2.0 system success

Traditional e-learning systems support “one-way” communication. Teachers provide knowledge for learners, but they are unable to use a student’s learning experiences to benefit the class as a whole. To address these problems, this study explores e-learning success factors via the design and evaluation of an e-learning 2.0 system. This study develops a theoretical model to assess user satisfaction and loyalty intentions to an e-learning system using communication quality, information quality, system quality, and service quality. The empirical results show that communication quality, information quality, and service quality significantly and positively affect user satisfaction and loyalty intentions to use the e-learning system for sharing experience, communicating with others, and getting feedback.     

The role of experience and innovation characteristics in the adoption and continued use of e-learning websites

With the advent of e-learning technologies in the past decade, the accessibility of training, teaching, and learning has drastically increased. The challenge for the education enterprise now is how to attract learners to their e-learning services. In this study, a technology adoption model is developed to predict the users’ intention of adoption and their continued use behavior. The results show significant evidence in support of the hypothesis. The findings indicate that perceptions of relative advantage and compatibility are significantly related to users’ intention to use e-learning. Also, the intention is significantly related to their actual use of e-learning. Furthermore, the technology adoption of learners with prior e-learning experience is different from those without prior e-learning experience. These findings may contribute to deeper understanding of e-learning users’ perceptions in terms of adoption and continued use behavior.     

Impact of media richness and flow on e-learning technology acceptance

Advances in e-learning technologies parallels a general increase in sophistication by computer users. The use of just one theory or model, such as the technology acceptance model, is no longer sufficient to study the intended use of e-learning systems. Rather, a combination of theories must be integrated in order to fully capture the complexity of e-learners, who are both system users and learners. The current research presents an integrated theoretical framework to study users’ acceptance of streaming media for e-learning. Three streams of research provide the basis for this integrated framework: the technology acceptance model, flow theory and media richness theory. Students enrolled in an online section of an information systems course used one of three different combinations of text, streamed audio and streamed video. Regression analysis was used to test the hypotheses in this field experiment. Perceived ease of use was a predictor of perceived usefulness; both the perceived usefulness and the attitude of the user were predictors of intention to use. Richer content-presentation types were positively correlated with higher concentration levels but showed mixed results when correlated with perceived usefulness. Results from this study have practical implications for those interested in integrating streaming media into e-learning.     

A distributed system for learning programming on-line

Several Web-based on-line judges or on-line programming trainers have been developed in order to allow students to train their programming skills. However, their pedagogical functionalities in the learning of programming have not been clearly defined. EduJudge is a project which aims to integrate the “UVA On-line Judge”, an existing on-line programming trainer with an important number of problems and users, into an effective educational environment consisting of the e-learning platform Moodle and the competitive learning tool QUESTOURnament. The result is the EduJudge system which allows teachers to apply different pedagogical approaches using a proven e-learning platform, makes problems easy to search through an effective search engine, and provides an automated evaluation of the solutions submitted to these problems. The final objective is to provide new learning strategies to motivate students and present programming as an easy and attractive challenge. EduJudge has been tried and tested in three algorithms and programming courses in three different Engineering degrees. The students’ motivation and satisfaction levels were analysed alongside the effects of the EduJudge system on students’ academic outcomes. Results indicate that both students and teachers found that among other multiple benefits the EduJudge system facilitates the learning process. Furthermore, the experiment also showed an improvement in students’ academic outcomes. It must be noted that the students’ level of satisfaction did not depend on their computer skills or their gender.     

Developing a model to assess the success of e-learning systems: evidence from a manufacturing company in transitional economy

This paper examines the success of an e-learning system in a company from the perspective of employees by using a multimethod approach. For this purpose Moodle learning management system was used. The success of e-learning as an information system was evaluated using four constructs of the updated DeLone and McLean IS success model—system quality, use, user satisfaction and net benefits, and adding one more construct—user performance. In this research a combination of observation and survey as two different research methods was used, which allowed the new measure to be incorporated into the model. Empirical assessment was carried out by exploratory factor analysis, confirmatory factor analysis and structural equation modeling. The research model was found to be valid and reliable. The results provide an expanded understanding of the constructs that measure the success of an e-learning system, helping to more deeply understand the key success dimensions and their interrelationships. The implications of our work were discussed. The DeLone and McLean IS success model applied equally well. However, the use of observation as a method of data collection revealed the weaknesses of the original model.     

IT infrastructure services as a requirement for e-learning system success

Evaluation of e-learning systems success is an essential process in managing and developing these types of systems. There are still arguments about the factors can be used to evaluate the success of e-learning systems. Inadequate attention has been paid to investigate the role of IT infrastructure services as a foundation to create the success of e-learning systems. The focus of this study is the role of IT infrastructure services in terms of the success of e-learning systems. A model is proposed which includes five constructs: IT infrastructure services; perceived usefulness; user satisfaction; customer value; and organizational value. A quantitative study was conducted at an Australian University, with survey responses from 110 Academic staff members and 720 students who use the e-learning system. The empirical study confirmed that an IT infrastructure services is a valid and reliable construct to measure e-learning systems success. In addition, this study provides evidence of the critical role of IT infrastructure services in the success of e-learning systems via its significant effect on perceived usefulness, user satisfaction, customer value, and organizational value.     

Exploration of an e-learning model to foster critical thinking on basic science concepts during work placements

We designed an e-learning model to promote critical thinking about basic science topics in online communities of students during work placements in higher education. To determine the effectiveness and efficiency of the model we explored the online discussions in two case studies. We evaluated the quantity of the interactions by looking at quantitative data of the discussion ‘threads’ and we evaluated the quality of the discussion by content analysis of the individual messages. Both the procedural facilitation of the discussion and the instrument for content analysis were based on Garrison’s ‘Practical Inquiry model of Cognitive Presence’. Furthermore, we explored the experiences of the students and moderators by interviewing them and we organised their perceptions using the framework of an activity system. On the basis of the quantitative and qualitative data we conclude that the e-learning model was successful in establishing a dialogue among a group of students and an expert during work placements at different locations. The ‘Practical Inquiry model’ was useful in facilitating a sustained on-topic discourse involving critical thinking. Although the amount of critical thinking was moderate, the results suggest ways to increase integration and resolution activities in the online discussions.     

Information Systems Use: Construct conceptualization and scale development

Information Systems Use (ISU) is an essential part of the human behaviors in utilizing computers in organizations. The construct has been widely used to measure IS adoption or IS success. However, few studies attempt to understand ISU in a job and organizational setting where employees use various types of IS for different tasks. To better understand ISU, it is necessary to contextualize the construct in users’ overall work related activities. We classified the overall IS/IT use in an organization into three different types of IS; Information Reporting Systems (IRSs), Decision Support Systems (DSSs), and Group Support System (GSSs). Based on this classification, we developed four items for each type of ISU behaviors. The resulting ISU instrument was tested using a dataset of 231 responses collected in a survey. Both exploratory factor analysis and PLS are employed to successfully establish reliability, convergent/discriminate validity, and predictive validity. The contribution of this research is to provide better and more robust measurements for the ISU construct, which should help to lay a firmer foundation for further research on IS success.     

Acceptance of competency-based workplace e-learning systems: Effects of individual and peer learning support

Current endeavors to integrate competency-based learning approaches with e-learning systems designed for delivery of training to adult learners in the workplace are growing. However, academic efforts in examining learners’ perceptions of, and reactions toward, this technology-delivered pedagogical innovation are limited. Drawing together perspectives from the literature on training and instructional design and technology acceptance, this research proposed a conceptual model to examine the influences of perceived individual and social learning support on employees’ acceptance of competency-based e-learning systems. Structural equation modeling and multi-group structural equation modeling techniques were applied to sample data collected from work settings in Mainland China. The results show the positive effects of perceived individual learning support and perceived support for promoting a norm of cooperation on employees’ intention to use the competency-based e-learning system. It was also found that perceived support for enhancing social ties had a negative effect on employees’ behavioral intention. The gender, age, prior experience, and work experience differences in the main effects were also investigated. Besides, qualitative data collected via semi-structured in-depth interview provide complementary evidence to the findings.     

Enhancing Employee Job satisfaction via E-learning: The Mediating Role of an Organizational Learning Culture

Although e-learning systems have been widely employed to develop employee learning at a workplace, discerning what influences the interaction between employee acceptance of an e-learning system within an organizational learning culture (OLC) and the resultant impact on job attitudes remains under-researched and requires further investigation. This study examined the relationship between employee perceptions of an e-learning system, the existing OLC, and job satisfaction. Structural equation modeling was applied to analyze data collected from 297 employees of a telecommunications company. The results suggest that employee acceptance of e-learning is a positive predictor of the OLC and employee job satisfaction. OLC mediates the relationship between the use and acceptance of e-learning by employees and their job satisfaction. Recommendations and implications are subsequently provided in terms of the future for human resource development researches and practices.     

How does leadership affect information systems success? The role of transformational leadership

We examined the positive impact of transformational leadership on IS success in organizations via two psychological mechanisms of system users’—perceived organizational support and systems self-efficacy. Our conceptual model was assessed using a sample of 251 employees from a multi-national bank in Korea. Overall, our results supported the hypothesized relationships: transformational leadership was positively related to system users’ IS success, and both perceived organizational support and systems self-efficacy of the system users mediated the relationship between transformational leadership and IS success. The results call for manager's attention to the importance of transformational leadership development in organizations.     

The role of task-technology fit as users’ motivation to continue information system use

In this study, we extend and combine the post-acceptance model (PAM), proposed by Bhattacherjee [Bhattacherjee, A. (2001). Understanding information systems continuance: An expectation–confirmation model. MIS Quarterly, 25(3), 351–370], with aspects of Goodhue and Thomson’s theory of task-technology fit (TTF). The original PAM emphasizes cognitive beliefs and user feelings as factors that may influence a person’s intention to continue to use an information system (IS). The variables added from TTF are task-technology fit and utilization. The sample consists of data that measure use and use-related aspects of an e-learning tool among university college teachers. Using structural equation modeling, results indicate that variables from TTF as well as variables from PAM explain users’ IS continuance intention. As a result of these findings, we propose the existence of two different and autonomous paths from the independent variables to the dependent variable of IS continuance intention. These two paths are: a work system-centric path through utilization of the information system, and an IT-centric path through user satisfaction.     

Towards a learning networked organisation: human capital, compatibility and usability in e-learning systems

In all parts of organisations there flourish developments of different new subsystems in areas of knowledge and learning. Over recent decades, new systems for classification of jobs have emerged both at the level of organisations and at a macro-labour market level. Recent developments in job evaluation systems make it possible to cope with the new demands for equity at work (between, for example, genders, races, physical abilities). Other systems have emerged to describe job requirements in terms of skills, knowledge and competence. Systems for learning at work and web-based learning have created a demand for new ways to classify and to understand the process of learning. Often these new systems have been taken from other areas of the organisation not directly concerned with facilitating workplace learning. All these new systems are of course closely interrelated but, in most organisations, a major problem is the severe lack of cohesion and compatibility between the different subsystems. The aim of this paper is to propose a basis for how different human resource systems can be integrated into the business development of an organisation. We discuss this problem and develop proposals alternative to integrated macro-systems. A key element in our proposition is a structure for classification of knowledge and skill to be used in all parts of the process. This structure should be used as an added dimension or an overlay on all other subsystems of the total process. This will facilitate a continued use of all existing systems within different organisations. We develop Burge's (personal communication) model for learning to show that learning is not a successive linear process, but rather an iterative process. In this way we emphasise the need for greater involvement of learners in the development of learning systems towards increased usability in a networked system. This paper is divided into two parts which are closely related. The first part gives an overview of the lack of compatibility between the different subsystems. In this first part we note two paradoxes which impact learning and for which we propose solutions. The second part deals with 'usability' aspects of these competency-related systems; in particular, usability in e-learning systems. In this second part we describe an example of a new organisational structure. We conclude by discussing four key concepts that are necessary conditions for organisations to address when developing their human capital. Establishing these conditions helps ensure compatibility and usability in e-learning systems.     

Multi-level analysis of peer support,Internet self-efficacy and e-learning outcomes – The contextual effects of collectivism and group potency

The present study intends to explore the role of collectivism and group potency at group level in predicting individual Internet self-efficacy (ISE) and individual e-learning outcomes for people aged over 45. Group learning has been widely discussed in the research into online formats. However, less study has been carried out about how collectivism and collective group potency affect individual learning decisions, especially using the technique of Hierarchical Linear Modeling (HLM) for cross-level analysis, which provides the solution of case dependency between group members. This study examines the mediation effects of ISE between peer support and e-learning outcomes. It also explores the contextual effects of group potency, and the moderation effects of collectivism and group potency at an individual level. The results show that ISE fully mediates the relationship between peer support and learners’ persistence in e-learning, and partially mediates learners’ perceived learning and satisfaction. It is noteworthy that the findings do not support direct group-level contextual effects of group potency. Instead, the results suggest that group potency moderates ISE-perceived learning and ISE-satisfaction relationships. On the other hand, collectivism also moderates the relationship between peer support and ISE. This study highlights the group-level effects of group potency, and suggests that adult educators design and deliver e-learning courses with an emphasis on facilitating group processes.     

Investigating e-learning system usage outcomes in the university context

This paper investigates the outcomes of e-learning systems adoption and use by conceptualizing three e-learning systems adoption outcome constructs namely perceived learning assistance, perceived community building assistance and perceived academic performance. Utilizing these constructs, the paper proposes a research model for assessing the possible outcomes of e-learning systems adoption and use. The study collected longitudinal survey data from 249 university students participating in hybrid courses using a popular learning management system, Moodle. Partial least squares (PLS) approach was then used to test the research model.The findings suggest that beliefs about perceived usefulness and perceived ease of use, and how an e-learning system is used influence students' perceived learning assistance and perceived community building assistance. In turn, perceived learning assistance and perceived community building assistance influence the students' perceived academic performance.     

How family support and Internet self-efficacy influence the effects of e-learning among higher aged adults – Analyses of gender and age differences

Gender and age differences in the effects of e-learning, including students’ satisfaction and Internet self-efficacy, have been supported in prior research. What is less understood is how these differences are shaped, especially for higher aged adults. This article examines the utility of family support (tangible and emotional) and Internet self-efficacy (general and communication) in predicting middle aged (aged 50–64) and older adults’ (over the age of 65) perceived effects of e-learning. A total of 290 adult participants aged over 50 who were registered in community college and senior learning center courses completed the measure of perceived family support, Internet self-efficacy and the effects of e-learning. By using structural equation modeling (SEM) and model invariance analysis, the results indicate that emotional family support plays a main role in predicting the effects of e-learning, mediated by general and communication Internet self-efficacy. Emotional family support has both direct and indirect influences on adults’ perceived effects of e-learning. Tangible support significantly predicts adults’ perceived effects of e-learning, mediated by Internet self-efficacy. Compared to male adult learners, female adults rely more on tangible family support for increasing their Internet self-efficacy. Similar patterns were presented by older participants. The similarities between women and older adults imply that the gender issue is not specifically related to sex itself, but relates to the complexity of the social context of these disadvantaged learners. The findings provide researchers, adult education practitioners and e-learning program planners with a direction towards understanding e-learning for middle and older aged adults.