The Intellectual Development of Science and Engineering Students. Part 1: Models and Challenges

As college students experience the challenges of their classes and extracurricular activities, most undergo a developmental progression in which they gradually relinquish their belief in the certainty of knowledge and the omniscience of authorities and take increasing responsibility for their own learning. At a high developmental level (which few reach before graduation), they recognize that all knowledge is contextual, gather and interpret evidence to support their judgments from a wide range of sources, and willingly reconsider those judgments in the light of new evidence. This paper reviews several models of intellectual development, discusses their applicability to science and engineering education, and defines the difficulties that confront instructors seeking to promote the development of their students. A companion paper formulates an instructional model for promoting development that addresses those difficulties.     

Pre‐college Electrical Engineering Instruction: The Impact of Abstract vs. Contextualized Representation and Practice on Learning

Background While engineering instructional materials and practice problems for pre‐college students are often presented in the context of real‐life situations, college‐level texts are typically written in abstract form. Purpose (Hypothesis ) The goal of this study was to jointly examine the impact of contextualizing engineering instruction and varying the number of practice opportunities on pre‐college students' learning and learning perceptions. Design/ Method Using a 3 × 2 factorial design, students were randomly assigned to learn about electrical circuit analysis with an instructional program that represented problems in abstract, contextualized, or both forms, either with two practice problems or four practice problems. The abstract problems were devoid of any real‐life context and represented with standard abstract electrical circuit diagrams. The contextualized problems were anchored around real‐life scenarios and represented with life‐like images. The combined contextualized‐abstract condition added abstract circuit diagrams to the contextualized representation. To measure learning, students were given a problem‐solving near‐transfer post‐test. Learning perceptions were measured using a program‐rating survey where students had to rate the instructional program's diagrams, helpfulness, and difficulty. Results Students in the combined contextualized‐abstract condition scored higher on the post‐test, produced better problem representations, and rated the program's diagrams and helpfulness higher than their counterparts. Students who were given two practice problems gave higher program diagram and helpfulness ratings than those given four practice problems. Conclusions These findings suggest that pre‐college engineering instruction should consider anchoring learning in real‐life contexts and providing students with abstract problem representations that can be transferred to a variety of problems.     

First Steps in Understanding Engineering Students' Growth of Conceptual and Procedural Knowledge in an Interactive Learning Context

The development of procedural knowledge in students, i.e., the ability to effectively solve domain problems, is the goal of many instructional initiatives in engineering education. The present study examined learning in a rich learning environment in which students read text, listened to narrations, interacted with simulations, and solved problems using instructional software for thermodynamics. Twenty‐three engineering and science majors who had not taken a thermodynamics course provided verbal protocol data as they used this software. The data were analyzed for cognitive processes. There were three major findings: (1) students expressed significantly more cognitive activity on computer screens requiring interaction compared to text‐based screens; (2) there were striking individual differences in the extent to which students employed the materials; and (3) verbalizations revealed that students applied predominantly lower‐level cognitive processes when engaging these materials, and they failed to connect the conceptual and procedural knowledge in ways that would lead to deeper understanding. The results provide a baseline for additional studies of more advanced students in order to gain insight into how students develop skill in engineering.     

Dynamics of Peer Education in Cooperative Learning Workgroups

Many recent studies demonstrate that cooperative learning provides a variety of educational advantages over more traditional instructional models, both in general and specifically in engineering education. Little is known, however, about the interactional dynamics among students in engineering work groups. To explore these dynamics and their implications for engineering education, we analyzed work sessions of student groups in a sophomore‐level chemical engineering course at North Carolina State University. Using conversation analysis as a methodology for understanding how students taught and learned from one another, we found that group members generally engaged in two types of teaching‐learning interactions. In the first type, transfer‐of‐knowledge (TK) sequences, they took on distinct teacher and pupil roles, and in the second, collaborative sequences (CS), they worked together with no clear role differentiation. The interactional problems that occurred during the work sessions were associated primarily with TK sequences, and had to do with students who either habitually assumed the pupil's role (constant pupils) or habitually discouraged others' contributions (blockers). Our findings suggest that professors can facilitate student group interactions by introducing students to the two modes of teaching interaction so group members can effectively manage exchanges of knowledge, and also by helping students distribute tasks in a way that minimizes role imbalances.     

Student Learning of Criterion 3 (a)‐(k) Outcomes with Short Instructional Modules and the Relationship to Bloom's Taxonomy

Engineering accreditation criteria require that engineering graduates demonstrate competency with a set of skills identified in Criterion 3 (a)‐(k). Because of a scarcity of instructional material on many of these topics, a team of engineering instructors developed and tested a set of short modules for teaching these skills. Using before and after module surveys, the students indicated their confidence in their ability to do specific tasks derived from the module's learning objectives. Data also were obtained with a control group not receiving the instruction. In comparing pre‐ and post‐module data, 33 percent of the comparisons were significantly different at the 0.05 level. In comparing control and post‐module data, the corresponding value was 44 percent. These results indicate that instruction with these short modules produced a significant effect on student learning.     

Designing and Teaching Courses to Satisfy the ABET Engineering Criteria

Since the new ABET accreditation system was first introduced to American engineering education in the middle 1990s as Engineering Criteria 2000, most discussion in the literature has focused on how to assess Outcomes 3a‐3k and relatively little has concerned how to equip students with the skills and attitudes specified in those outcomes. This paper seeks to fill this gap. Its goals are to (1) overview the accreditation process and clarify the confusing array of terms associated with it (objectives, outcomes, outcome indicators, etc.); (2) provide guidance on the formulation of course learning objectives and assessment methods that address Outcomes 3a‐3k; (3) identify and describe instructional techniques that should effectively prepare students to achieve those outcomes by the time they graduate; and (4) propose a strategy for integrating program‐level and course‐level activities when designing an instructional program to meet the requirements of the ABET engineering criteria.     

Kirkpatrick's Level 1 Evaluation of the Implementation of a Computer‐Aided Process Design Tool in a Senior‐Level Engineering Course

Computer simulation tools are frequently used in engineering design work, and undergraduates are often trained to use these tools as they learn to design systems. The use of new tools in the learning environment should be evaluated to assure that the students are able to use the tools effectively. This study details and demonstrates the use of a Kirkpatrick's Level 1 Evaluation to assess the effectiveness of an instructional environment in which students learn to use a computer simulation tool to perform engineering design work. Specifically, an evaluation was conducted to look at student perceptions of FOODS‐LIB—a steady‐state food process design tool, its user's manual learning modules, and the implementation of FOODS‐LIB in a senior level design course. This evaluation was triangulated with an instructor's assessment of student products generated as the students used the learning modules and designed an ice cream manufacturing process using FOODS‐LIB.     

A Multimodal Exploration of Engineering Students' Emotions and Electrodermal Activity in Design Activities

Background

This exploratory study uses multimodal approaches to explore undergraduate student engagement via topic emotions and electrodermal activity (EDA) in different engineering design method activities and with different instructional delivery formats (e.g., lecture vs. active learning).

Purpose/Hypothesis

The goal of this research is to improve our understanding of how students respond, via engagement, to their engineering design activities during class. This study hypothesizes that students would experience no self‐reported mean changes in topic emotions from their preassessment scores for each engineering design topic and instructional format nor would electrodermal activities (EDA) associate to these topic emotions throughout the design activities.

Design/Method

Eighty‐eight freshmen engineering students completed online pretopic and posttopic emotions surveys for five engineering design activities. A subset of 14–18 participants, the focal point of this study, wore an EDA sensor while completing the surveys and participating in these sessions.

Results

Preliminary findings suggest that EDA increased for individual and collaborative active learning activities compared to lectures. No significant changes in EDA were found between individual and collaborative active learning activities. Moderate negative correlations were found between EDA and negative topic emotions in the first engineering design activity but not across the rest. At the end of the semester, active learning activities showed higher effect sizes indicating a re‐enforcement of students' engagement in the engineering design method activities.

Conclusion

This study provides initial results showing how multimodal approaches can help researchers understand students' closer‐to‐real‐time engagement in engineering design topics and instructional delivery formats.     

The Development of Adaptive Expertise in Biomedical Engineering Ethics

This paper is an investigation of the How People Learn (HPL) Legacy Cycle's ability to expand adaptive expertise across the developmental span of high school and college. Participants included high school and college students. Pre‐test data indicated younger students (high school and first‐year college students) were less knowledgeable about the science of stem cells than older students (second‐, third‐, and fourth year college students), and all students were low in adaptiveness. Post‐test data showed that younger students achieved parity with the more advanced students in basic scientific knowledge. The younger students also became highly adaptive by the post‐test, but the older students did not advance beyond their pre‐curriculum levels. We hypothesize that the older students began the intervention with more preconceived notions about stem cells, and thus were less able to think and analyze flexibly within that framework.     

Supporting Mechanical Reasoning with a Representationally‐Rich Learning Environment

A learning environment to support mechanical reasoning and understanding of simple machines for middle school and high school students is presented, along with results of an evaluation of its effectiveness in student learning. Based on recommendations from literature on instructional frameworks and cognitive aspects of mechanical reasoning, SIMALE (the Simple Machines Learning Environment) was designed to support reflection, collaboration, and presentation of concepts from multiple perspectives. SIMALE was implemented with a diverse population of middle and high school students with three treatment variations: (1) environment with focus on Lego exercises to engage in hands‐on physical activities, (2) environment with focus on a Web‐based computer module, and (3) environment with both the computer module and Lego exercises. Analyses of results show significant increases in post‐test performance for all treatment variations within SIMALE. The results also revealed unexpected dramatic results in equalizing post‐test scores along ethnic and gender dimensions, in spite of large population differences in pre‐test scores.     

Cooperative Learning Instructional Activities in a Capstone Design Course

In developing our capstone design course, we decided to include instruction in design methodology, project management, engineering communications, and professional ethics, along with a comprehensive design project. As this course evolved over a number of years, we found that active and cooperative learning was critical for effective instruction in these topics and we developed a series of instructional activities using this methodology. These activities consisted of short presentations (mini‐lectures) with interspersed team exercises. We describe our course, these instructional activities, and some evaluation data showing that our students found them effective and important. Our experiences convinced us that the cooperative learning approach both enhanced our students' understanding of these topics and encouraged them to incorporate the associated skills into their working skill set. Including team exercises that dealt with various steps in the design process provided a “jump‐start” on these unfamiliar activities in a structured, short duration exercise environment in class. Listening to presentations by other teams and reviewing and discussing another team's results as a part of the team exercises provided an opportunity to see and think about different formulations of the problem they just considered.     

Collaborative Learning vs. Lecture/Discussion: Students' Reported Learning Gains*

This study examined the extent to which undergraduate engineering courses taught using active and collaborative learning methods differ from traditional lecture and discussion courses in their ability to promote the development of students' engineering design, problem‐solving, communication, and group participation skills. Evidence for the study comes from 480 students enrolled in 17 active or collaborative learning courses/sections and six traditional courses/sections at six engineering schools. Results indicate that active or collaborative methods produce both statistically significant and substantially greater gains in student learning than those associated with more traditional instructional methods. These learning advantages remained even when differences in a variety of student pre‐course characteristics were controlled.     

Evaluating the Effectiveness of Computer Tutorials Versus Traditional Lecturing in Accounting Topics

Colleges and universities are continually making efforts to incorporate computers and technology into the varied aspects of their teaching environments. However, it is difficult to distinguish the effectiveness of these machine tutors from their human counterparts. There has been much debate about technology‐based instructional strategies in learning environments. This article addresses one issue of that debate—the effectiveness of teaching undergraduate engineering students using computer‐mediated tutorials versus traditional lecturing. Specifically, this research compared student test scores using computer‐mediated accounting tutorials alone with those of students who received traditional lectures and computer‐mediated tutorials on the same topic. Statistical analyses were performed to determine which was a better instructional method. Based on previous research by the authors and other published research, it was hypothesized that both methods would be satisfactory instructional tools and yield similar educational results. The results indicate that there was no statistically significant difference between the two methods. This was consistent with previous studies. This study concludes that computer‐mediated tutorials could be substituted for traditional lectures without impacting what a student learns—at least for teaching accounting fundamentals.     

Case Learning Methodology in Operations Engineering

Teaching operations engineering to traditional and non‐traditional engineering students using case learning methods presents both instructional challenges and provides learning rewards when performed properly. Unfortunately, few engineering faculty have had exposure to this learning approach. However, the skills are learnable and the results satisfying to instructor and student alike. The purpose of this paper is to explore case learning methods and illustrate their appropriateness for a course in operations engineering.     

A Paradigm for Assessing Conceptual and Procedural Knowledge in Engineering Students

Conceptual and procedural knowledge are two mutually‐supportive factors associated with the development of engineering skill. The present study extends previous work on undergraduate learning in engineering to provide further validation for an assessment paradigm capable of quantifying engineering students' conceptual and problem‐solving knowledge. Eight students who were enrolled in an introductory thermodynamics course and four who were enrolled in the course sequel provided verbal protocol data as they used instructional software. They were compared to existing data from a cohort of eleven science and engineering majors who had not taken thermodynamics. The results replicated earlier findings showing more cognitive activity on computer screens requiring overt user interaction compared to text‐based screens. The data also indicated that higher‐ versus lower‐performing students, based on course grades, engaged in more higher‐order cognitive processing. There was no evidence that students gained deeper cognitive processing as they advanced through the engineering curriculum.     

Faculty Use and Impressions of Courseware Management Tools: A National Survey

Technology in the classroom is changing the way faculties instruct and students learn. Understanding how faculty members perceive and use technology for learning is important for improving the educational process because instructor perceptions can potentially be a hindrance to the use and implementation of technology. This paper describes the results of a survey that investigated faculty Internet usage for instructional purposes as well as their perceptions of courseware management and Web‐publishing tools. The survey targeted a random sample of engineering faculty at ABET‐accredited universities. The survey results show that while many faculty members are using both Web‐publishing tools and courseware management tools for delivering educational content, they use these tools for only a small subset of pedagogical activities.     

The Role of Collaborative Reflection on Shaping Engineering Faculty Teaching Approaches

Over the last several years, engineering faculty and learning scientists from four universities worked in collaboration to develop educational materials to improve the quality of faculty teaching and student learning. Guided by the How People Learn (HPL) framework, engineering faculty worked in collaboration with learning scientists to develop learner‐centered, student‐focused instructional methods. In consultation with learning scientists, engineering faculty carried out educational inquiry in their classrooms aimed at investigating student learning and enhancing instruction. In this paper we discuss the extent to which faculty engaged in these collaborative endeavors and how their teaching approaches differed as a result of their level of engagement. Study findings reveal the role that collaborative reflection plays in shaping teaching approaches. Results from this study provide insights for researchers and other practitioners in engineering and higher education interested in implementing engineering faculty development programs to optimize the impact on teaching.     

Self‐directed Learning Readiness Among Engineering Undergraduate Students

Two studies related to readiness for self‐directed learning of engineering students were performed using the Self‐directed Learning Readiness Scale (SDLRS). A cross‐sectional study of students in the first through final years of study showed that their SDLRS scores are significantly correlated with academic year of study and with grade point average, but not with gender. However, neither academic year of study nor grade point average is a good predictor of SDLRS scores; together they account for less than 5 percent of the observed variance. A second study investigated the effect of a problem‐based learning experience on students' readiness for self‐directed learning. It showed that the average readiness for self‐directed learning increased significantly for students in the problem‐based learning courses. However, investigation of the changes for individual students revealed that only nine of eighteen students showed significant increases in their SDLRS scores, and two showed significant decreases. Potential underlying causes are explored.     

Applying Kolb's Experiential Learning Cycle for Laboratory Education

This paper describes a model for laboratory education based on Kolb's experiential learning theory. The method is implemented using modern teaching technologies and a combination of remote, virtual, and hands‐on laboratory sessions and have been applied to the teaching of the undergraduate process control laboratory at the Chemical Engineering Department at Loughborough University, United Kingdom. An argument that poor learning in the laboratory is due to insufficient activation of the prehension dimension of Kolb's cycle was suggested and verified, providing a pedagogical explanation. The quantitative analysis showed significant enhancement of the learning outcomes of the experimental group compared with the control group. Apart from the hands‐on session, the proposed model involves additional activities, such as pre‐ and post‐lab tests and virtual laboratory sessions, which are associated with Kolb's cycle to facilitate constructivist learning. The paper provides the first laboratory education model that builds thoroughly on Kolb's experiential learning theory.     

Evaluation of Instructional Design of Computer‐Based Teaching Modules for a Manufacturing Processes Laboratory

Studies concerning student preferences and student learning as a function of the instructional design and delivery of a computer‐based teaching (CBT) module are presented. The studies were conducted in conjunction with the development of twenty‐one CBT modules for an Introduction to Manufacturing Processes laboratory that emphasized metal removal. Study results indicate there is no statistically relevant difference in learning between students using material presented with traditional multimedia (35 mm slides and cassette tapes) and the identical material presented with digital multimedia. Engineering students' preferences for interface design and audio‐visual information presentation are also presented. The most important result is that learning outcomes of a reader‐driven CBT module were found to be statistically lower than those associated with author‐driven CBT module, especially for average and below‐average students. These results suggest that if students must absolutely understand material, e.g., laboratory safety, the CBT should be author‐driven. Based on these results, we speculate that average and below average engineering students are more linear learners. A hybrid scheme, where information presentation transitions from an author‐driven to a reader‐driven environment may help weaker students develop better non‐linear, open‐ended problem solving skills.