Relationship Between TOEFL Score and Academic Success for International Engineering Students

Background Tests that classify English ability, such as the Test of English as a Foreign Language (TOEFL), are often the only application metric common to international applicants from a wide variety of academic backgrounds. As such, these test results are sometimes used beyond their intended scope to predict student academic success. Purpose (Hypothesis ) This study evaluated relationships between TOEFL scores and several measures of academic success for students at an American university abroad. Characterizing these relationships helps assess the scope of the TOEFL score's use in admissions decision making. Design /Method Linear and logistic regression were used to evaluate TOEFL score relative to overall grade point average (GPA), GPA for courses in engineering and in humanities, rate of passing a Comprehensive Assessment Examination (CAE), and graduation rate. High school GPA, gender, and nationality were also included as independent variables. Results A positive, statistically significant relationship was identified between TOEFL score and GPA, although weaker for engineering students than students in other fields, and for engineering courses than non‐engineering courses. TOEFL score was also statistically significant in logistic regressions of CAE pass rate and graduation rate, indicating increasing probability of success with increasing TOEFL score. However, model goodness‐of‐fit measures were relatively low, indicating many students whose performance defies general trends. Conclusions In spite of correlations between TOEFL score and academic performance, TOEFL scores should not be used in admissions beyond assessing individual students' English proficiency. Additional research is warranted to investigate trends that were identified related to gender effects and engineering‐specific student learning styles.     

Project Preserve: A Program to Retain Minorities in Engineering

A national effort, begun in 1972 to increase the numbers of minorities in engineering, has made substantial progress, but the attrition for minority students is still estimated at 70%. To address the problem, Project Preserve was designed to confirm, by demonstration, the results of previous research showing that the combination of explicit cognitive development, close relationships with faculty, and strong bonds to an institution can raise the performance and retention of minority engineering students. The project enrolled over 100 minority engineering students who had been dismissed from freshman engineering studies on other campuses or placed on academic probation, but whose high school grades and SAT scores were indicative of success. They were channeled into participating institutions chosen for their record of basic support services, willingness to augment or restructure those services, and for variation among institutional variables: Xavier University of Louisiana (XU), California State University at Northridge (CSUN), and City College of the City University of New York (CCNY). A 2 1/2 hour battery of evaluation instruments was given to 79 students upon entry and to 26 students upon their attaining Junior status after two years in the program. The results demonstrated that: (1) an admirable 64% of would-be drop outs had achieved Junior status or were still enrolled in engineering at the conclusion of two years; (2) cognitive growth occurred on basic memory skills and one critical thinking skill, but there were institutional differences in the extent of intellectual development, with Xavier producing the most change; (3) closer relationships to faculty were outcomes; (4) the most positive feelings about, or bonding to, the institution occurred at Xavier University, while the most evidence of social participation and connectedness occurred at CSUN.     

Understanding the Role of Self‐Efficacy in Engineering Education

The engineering professor's role is dualistic in the sense that not only must s/he create an academic environment conducive to the acquisition of course content but must also prepare students to become practicing professionals. This dualism requires that the professor both motivate good study habits as well as build within students the confidence that they have the requisite capability to perform actual engineering. Self‐efficacy, simply defined as one's self‐judgment concerning capability, has been shown to be an important mediating factor in cognitive motivation. This paper describes the motivating role of the professor, theories of motivation, the role of self‐efficacy in motivation, and guiding principles that can be used to enhance self‐efficacy in engineering students. These principles can serve as guidelines in designing instructional delivery strategies that motivate engineering students to engage in behaviors conducive to becoming value‐added practitioners.     

Experiential Learning Environments: Do They Prepare Our Students to be Self‐Directed,Life‐Long Learners?

Recent research indicates that traditional academic structures may not effectively promote self‐directed learning. We investigated whether an experiential interdisciplinary projects program, called the Global Studies Program, increased readiness for self‐directed learning (SDL) and life‐long learning (LLL) using three methods: a nationally recognized course evaluation system called the Individual Development and Educational Assessment system (IDEA); an internal student project quality assessment protocol; and the Self‐Directed Learning Readiness Scale (SDLRS). Student self‐assessments through the IDEA system showed Global Studies Program students reported much greater progress in LLL‐related skills than did national and local comparison groups. Similarly, review of student projects by independent faculty teams found Global Studies Program students consistently outscored on‐campus project students in LLL‐related measures by wide margins. The SDLRS also showed a positive, but less emphatic increase in SDL readiness among a Global Studies Program cohort. The research demonstrates the success of one experiential learning environment in promoting SDL/LLL, while raising interesting issues regarding alternative methods of measuring potential benefits.     

Is Modeling of Freshman Engineering Success Different from Modeling of Non‐Engineering Success?

The engineering community has recognized the need for a higher retention rate in freshman engineering. If we are to increase the freshman retention rate, we need to better understand the characteristics of academic success for engineering students. One approach is to compare academic performance of engineering students to that of non‐engineering students. This study explores the differences in predicting academic success (defined as the first year GPA) for freshman engineering students compared to three non‐engineering student sectors (Pre‐Med, STEM, and non‐STEM disciplines) within a university. Academic success is predicted with pre‐college variables from the UCLA/CIRP survey using factor analysis and regression analysis. Except for the factor related to the high school GPA and rank, the predictors for each student sector were discipline specific. Predictors unique to the engineering sector included the factors related to quantitative skills (ACT Math and Science test scores and placement test scores) and confidence in quantitative skills.     

Self‐directed Learning Readiness Among Engineering Undergraduate Students

Two studies related to readiness for self‐directed learning of engineering students were performed using the Self‐directed Learning Readiness Scale (SDLRS). A cross‐sectional study of students in the first through final years of study showed that their SDLRS scores are significantly correlated with academic year of study and with grade point average, but not with gender. However, neither academic year of study nor grade point average is a good predictor of SDLRS scores; together they account for less than 5 percent of the observed variance. A second study investigated the effect of a problem‐based learning experience on students' readiness for self‐directed learning. It showed that the average readiness for self‐directed learning increased significantly for students in the problem‐based learning courses. However, investigation of the changes for individual students revealed that only nine of eighteen students showed significant increases in their SDLRS scores, and two showed significant decreases. Potential underlying causes are explored.     

Women Engineering Students and Self‐Efficacy: A Multi‐Year,Multi‐Institution Study of Women Engineering Student Self‐Efficacy

As our nation's need for engineering professionals grows, educators and industry leaders are increasingly becoming concerned with how to attract women to this traditionally male career path. Self‐efficacy has been shown to be related to positive outcomes in studying and pursuing careers in non‐traditional fields. This paper describes the results of two years of engineering self‐efficacy data collected from women engineering students at five institutions across the U.S. This study adds to the growing body of self‐efficacy literature via its multi‐year, multi‐institution design and helps to clarify the impact of the engineering curriculum on self‐efficacy. Results indicate that while women students show positive progress on some self‐efficacy and related subscales, they show a significant decrease on feelings of inclusion from the first to second measurement period and further suggest a relationship between ethnicity and feelings of inclusion. Additionally, correlations show that self‐efficacy is related to women students' plans to persist in this predominantly male discipline.     

Factors Influencing the Self‐Efficacy Beliefs of First‐Year Engineering Students

A survey incorporating qualitative measures of student self‐efficacy beliefs was administered to 1,387 first‐year engineering students enrolled in ENGR 106, Engineering Problem‐Solving and Computer Tools, at Purdue University. The survey was designed to identify factors related to students' self‐efficacy beliefs, their beliefs about their capabilities to perform the tasks necessary to achieve a desired outcome. Open‐ended questions prompted students to list factors affecting their confidence in their ability to succeed in the course. Students were then asked to rank these factors based on the degree to which their self‐efficacy beliefs were influenced. Gender trends emerged in student responses to factors that affect confidence in success. These trends are discussed in light of the categories identified by efficacy theorists as sources of self‐efficacy beliefs. The results presented here provide a useful look at the first‐year engineering experiences that influence students' efficacy beliefs, an important consideration in explaining student achievement, persistence, and interest.     

The Sunrayce '95 Idea: Adding Hands-on Design to an Engineering Curriculum

During the 1994-95 academic year, Catalano taught a first-time senior capstone design class with the goal of entering a student-designed and built, solar-powered race car in the Department of Energy's Sunrayce '95 competition. This course came from an effort to move toward a more fully integrated mechanical engineering curriculum designed to supplement the learning experiences of students in their more traditional engineering courses. In this paper, we summarize the planning for the course, the design and construction phases of the class—especially how students and faculty perceived their design work, the cadets' perceptions of their learning during the class, and experiences of the students and faculty during the race. Teaching this new course provided insights into some of the dilemmas raised when changes to an existing curriculum are made.     

Making Engineering Education Fun

Maintaining student interest is more than an academic exercise. Institutions or departments that fail to challenge and actively involve their students in the learning process risk losing them to competing programs where the curricula are more dynamic and relevant. Within the Department of Nuclear Engineering at Oregon State University, we continually seek innovative ways to promote student retention while maintaining academic excellence. One recent effort was to restructure a first‐year nuclear engineering/health physics course. Using nuclear techniques, students were required to solve a fictitious murder. In the process they learned about teamwork, nuclear forensics methods, radiation protection, and basic radiation interactions. The class members were brought into the mystery playing the part of “graduate students” who helped their police‐detective uncle solve the case. To assist in their investigation the students subpoenaed expert “witnesses” to educate them on nuclear principles. The students, through homework, explained their actions, methods, and reasoning to a nontechnical participant (their “uncle“). By building on knowledge gained through interviews and homework, the students were able to solve the mystery. This mode of teaching requires extensive hands‐on faculty participation. However, the potential long‐term benefit is increased comprehension of course content as well as greater student interest and retention.     

The Effect of Social Presence on Affective and Cognitive Learning in an International Engineering Course Taught via Distance Learning

Background Distance learning course formats can alter modes of information exchange and interpersonal interaction relative to traditional course formats. Purpose (Hypothesis ) To determine the effect of a distance course format on the knowledge acquisition (cognitive learning) and satisfaction (affective learning) of students, we investigated student learning responses and social presence during a graduate‐level engineering course taught via traditional (i.e., professor present in the classroom) and synchronous distance‐learning formats. Design /Method Direct quantification of participation, academic performance assessment based on homework and exam scores, and survey‐based assessments of student perceptions of the course were collected. Based on these data, cognitive and affective learning responses to different technological and interaction‐based aspects of the course were determined for each course format. Results We show that while affective learning decreased for students in the distance format course relative to the traditional format, cognitive learning was comparable. Our results suggest that loss of satellite connection and audio losses had a stronger negative effect on student perceptions than video disturbances, and that participation was the most important factor influencing affective learning. Conclusions While our findings do not suggest that cognitive learning is strongly affected by social presence, implementing strategies to enhance social presence may improve the overall learning experience and make distance learning more enjoyable for students.     

Assessing the Process Maturity Utilized in Software Engineering Team Project Courses*

Many computer science departments offer an introductory software engineering course, which normally provides an introduction to software engineering topics in conjunction with a semester long team project. To ensure students acquire the correct lessons from this project experience, it is essential that the teams utilize well‐defined software development processes similar to those practiced by leading software development organizations. Since its inception, the Software Engineering Institute Capability Maturity Model (CMM) has served as a guide for organizations seeking to improve their development practices, through a self‐assessment questionnaire. In an effort to assess the maturity of development practices utilized in software engineering courses, an “academic” version of the CMM questionnaire was developed. This questionnaire was distributed to a sample of software engineering instructors in an effort to assess the maturity of academic software engineering course projects. The questionnaire and the survey results are presented and discussed.     

Bringing Adjunct Engineering Faculty into the Learning Community

Adjunct faculty can offer enrichment to an engineering program by bringing practical experience and by introducing relevant industrial applications and problems to the classroom. The industrial perspective of adjunct faculty often manifests itself through an emphasis on communication and presentation skills, and concern for customer needs. Students observing these attributes come away with a better appreciation for the demands of the engineering workplace. Adjunct faculty members can also provide important linkages for developing industrial affiliate programs, co‐op activities, and employment opportunities for graduates. Nevertheless, the position of adjunct faculty is tenuous, subject to shifting enrollments, negative student perception, and limited connectivity with the mainstream issues of the academic department. Adjunct faculty who teach in engineering programs will almost always come with excellent technical credentials, but they will have little or no teacher training or knowledge of learning principles and cognitive psychology. With limited time on campus, adjunct faculty have little opportunity to improve their teaching skills and methods, resulting in a “sink or swim” environment. At the Colorado School of Mines (CSM), we have evolved a regimen of strategies to ensure the quality of the educational program and to support the teaching effectiveness and professional commitment of adjunct faculty. These strategies have improved student and faculty satisfaction with adjunct faculty, and indeed have improved adjunct faculty self‐satisfaction. These strategies are described in the current paper.     

Effects of Faculty Interaction and Feedback on Gains in Student Skills*

Previous research has identified several variables that affect students' course satisfaction and gains in learning outcomes. The purpose of this article is to provide the reader with insights about the relationships between faculty‐student interaction and students' perceptions of selected skills and attitudes. This study specifically examined the relationships between engineering faculty teaching practices, classroom climate, and students' perceptions of their gains in communication skills, problem‐solving skills, occupational awareness, and engineering competence in a curriculum emphasizing engineering design activities. Data were gathered from more than 1,500 students taking the first‐year design course offered at 19 campuses of the Penn State system over a period of two years. The results suggest that faculty interacting with and providing constructive feedback to students were significantly and positively related to students' self‐reported gains in several design and professional skills. These relationships remained after controlling for student demographic characteristics and campus location. Recommendations regarding specific teaching practices are provided.     

Identifying Factors Influencing Engineering Student Graduation: A Longitudinal and Cross‐Institutional Study

Pre‐existing factors are quantitatively evaluated as to their impact on engineering student success. This study uses a database of all engineering students at nine institutions from 1987 through 2002 (a total of 87,167 engineering students) and focuses on graduation in any of the engineering disciplines. We report graduation rate as a function of years since matriculation, and determine the typical time‐to‐graduation. A multiple logistic regression model is fitted to each institution's data to explore the relationship between graduation and demographic and academic characteristics. A pooled model is fitted to six institutions where a complete data set was available. High school GPA, gender, ethnicity, quantitative SAT scores, verbal SAT scores, and citizenship had significant impact on graduation. While HSGPA, SATQ were significant for all models tested, the significance of other predictors varied among institutions. These studies add to the existing body of research about factors affecting the success of engineering students.     

A Teaching Workshop for Engineering Faculty

A quality engineering education is of utmost importance to undergraduate students seeking an engineering degree. Providing a quality education to these students is the responsibility of engineering faculty. The Department of Civil and Environmental Engineering at Utah State University (USU), in cooperation with the officers of the student chapter of the American Society of Civil Engineers (ASCE), has developed a series of six lessons focusing on teaching skills and faculty performance in the classroom. This series of lessons, known as the “Undergraduate Teaching Workshop”, is an effort to improve the teaching of the department faculty, and thereby the undergraduate education of its students. The lessons that make up this workshop range from student concerns to the use of learning resources and equipment. This paper discusses the workshop format and the experience we had with the workshop as it was conducted within our department.     

Assigning Functional Groups: The Influence of Group Size,Academic Record,Practical Experience,and Learning Style

This paper summarizes the results of a four-year study (September 1992 - December 1995) concerned with the performance of student groups in a senior engineering laboratory course. The investigation was conducted in two stages. In the first two years, the effect of group size, incoming GPA, practical experience, and the gender distribution of each group was investigated. During this period we recorded the Kolb Learning Style Inventory (LSI) scores at the end of the semester and asked students to report on the performance of their groups given their knowledge of the LSI distribution within their team. In the second stage of this study (1994–95) we evaluated the effect of grouping according to LSI, in addition to continuing our study of the effect of group size, academic record, practical experience, and gender distribution. In the final year of the study we took advantage of the disparity in the incoming GPAs of the two sections of the class (Tuesday and Thursday) to evaluate if incoming GPA influenced course grade. The study consisted of four senior classes totaling 110 students in 33 groups. The learning styles distribution of the students resulted in 6% “Type 1,” 42% “Type 2,” 42% “Type 3,” and 10% “Type 4” learners. The metric used to quantify performance was the average final course grade of students within given groups. This course grade was equally weighted between technical and writing components. Our results indicate that the most important positive correlating factor in a group's performance was the group size (four member groups statistically outperformed three member teams at α = 0.05). Although not statistically significant, observable higher average group grades indicated that the following may have an effect on group performance: the inclusion of academically outstanding individuals, the number of members with “good hands,” and the GPA history of the group. Specifically, the inclusion of a student with a GPA above 3.6 improved the performance (average group grade) of the group relative to their abilities as characterized by their average incoming GPA. Students who were good with equipment or had some practical hands-on experience had a similar positive influence on the group performance. The gender distribution within a group did not have a significant effect on either group performance or dysfunction. Insufficient data were collected to ascertain the relative performance of homogeneous and mixed learning style groups. Since group incoming GPA may be a variable in group performance, student self-selection is not recommended since it would result in an amplified disparity in the course grades. Indeed, we observed that grouping students by GPA, group size, and LSI resulted in a large number of functional teams, with the final variance in the course grade within a class reduced relative to other courses which have grouped activities.