Web‐Based Readiness Assessment Quizzes

Student readiness to fully participate in designed educational activities is often impeded by a lack of individual preparation through assigned readings or study. However, student preparation is rarely treated as an integral part of course design. Consequently, web‐based readiness assessment quizzes were developed for three courses in biological/biosystems engineering, at the freshman and junior levels. The overall goal was to improve student preparatory reading by assessing lower‐level knowledge just prior to the class period when that knowledge is needed for higher‐level learning activities. In this way, a web‐based educational tool was utilized as an integral, rather than just supplemental, part of the course design. The quizzes were designed to simultaneously ensure/assess student preparation and guide the students toward the highest priority topics within a given unit. The quizzes were graded automatically with the results reported electronically to the instructor. Student likelihood to read assigned materials was significantly improved (P < 0.0001), based on ratings from students in three different courses over four years of using these quizzes.     

Improving Visualization Skills of Engineering Graphics Students Using Simple JavaScript Web Based Games

A number of web‐based games were created using simple JavaScript code to teach visualization skills needed for a course in engineering graphics. The games are part of a comprehensive multimedia instructional CD‐ROM/web page that consists of an integrated web site with links to hours of tutorial movies, lecture presentations of class lectures, and a series of interactive web‐based quizzes. The web‐based games provide an interactive graphics based introduction to engineering graphics and a class design project. In addition, several games are devoted to the development of visualization skills in the areas of multiview drawings and pictorials, auxiliary views, the manipulation of objects and coordinate systems in a 3‐D coordinate space, and dimensioning and tolerancing. The games provide an interactive learning experience for students where tutorial animations specific to the students needs are interjected into the games. The feedback based on student input in the games allows the students to learn and apply new concepts simultaneously. The impact of the game pages on student understanding and the development of visualization skills have been positive as evidenced by improved performance on exams and positive feedback on surveys. The overall effectiveness of the instructional CD has also been positive, and this continues to be used and expanded.     

Student Performance and Acceptance of Instructional Technology: Comparing Technology‐Enhanced and Traditional Instruction for a Course in Statics

The College of Engineering at the University of Cincinnati has evaluated the use of instructional technologies to improve the learning process for students in fundamental engineering science courses. The goal of this effort was to both retain more students in engineering programs and improve student performance through appropriate use of technology. Four modes of instruction were used to teach an engineering fundamentals course in statics. A traditional instructor‐led course, a Web‐assisted course, a streaming media course, and an interactive video course were all presented using a common syllabus, homework, tests, and grading regimen. Evaluations of final course grades indicate that use of instructional technology improved student performance when compared with traditional teaching methods. Student satisfaction with technology varied considerably with the Web‐assisted format having the highest student approval rating of the technologies. The results indicate that time on task and interest in content can be improved through the appropriate use of technology.     

Comparison of Student Learning in Physical and Simulated Unit Operations Experiments

Industries are tending toward computer‐based simulation, monitoring, and control of processes. This trend suggests an opportunity to modernize engineering laboratory pedagogy to include computer experiments as well as tactile experiments. However, few studies report the impact of simulations upon student learning in engineering laboratories. We evaluated the impact of computer‐simulated experiments upon student learning in a senior unit operations laboratory. We compared data on control and test groups from three sources: 1) a comprehensive exam over the course; 2) a questionnaire answered by students regarding how well the areas of ABET Engineering Criterion 3 (a‐k) were met; and 3) oral presentations given by the students. Our results indicate that student learning is not adversely affected by introducing computer‐based experiments. We therefore conclude that, while the tactile laboratory should remain in the engineering curriculum, the pedagogy can reflect the increasing use of information technology in the manufacturing industries without compromising student learning.     

Engineering Entrepreneurship: An Example of A Paradigm Shift in Engineering Education

This paper describes a course on technology‐based entrepreneurship. Brown University's Division of Engineering has created a two‐semester course sequence designed to introduce students to entrepreneurship through a unique merger of classroom learning and industry participation. The course is open to advanced undergraduates from all engineering disciplines, and emphasis is placed upon recruiting almost half of the student participants from outside of engineering in order to develop “team building” skills. Local “parent companies” provide seed ideas or concepts to student groups who use skills learned in the classroom (both in this course as well as other courses) to develop and refine the parent company's idea and turn it into a viable simulated spin‐off business or new start‐up. Managers from the parent companies serve in an evolving role over the two‐semester sequence beginning as a “board of directors” for the spin‐off and eventually evolving into a potential source of start‐up capital (or possibly a customer for the products of the company). The faculty carefully manage the student‐company interface. Deliverables at the end of the two‐semester sequence include a business plan and a prototype product.     

The Effect of Social Presence on Affective and Cognitive Learning in an International Engineering Course Taught via Distance Learning

Background Distance learning course formats can alter modes of information exchange and interpersonal interaction relative to traditional course formats. Purpose (Hypothesis ) To determine the effect of a distance course format on the knowledge acquisition (cognitive learning) and satisfaction (affective learning) of students, we investigated student learning responses and social presence during a graduate‐level engineering course taught via traditional (i.e., professor present in the classroom) and synchronous distance‐learning formats. Design /Method Direct quantification of participation, academic performance assessment based on homework and exam scores, and survey‐based assessments of student perceptions of the course were collected. Based on these data, cognitive and affective learning responses to different technological and interaction‐based aspects of the course were determined for each course format. Results We show that while affective learning decreased for students in the distance format course relative to the traditional format, cognitive learning was comparable. Our results suggest that loss of satellite connection and audio losses had a stronger negative effect on student perceptions than video disturbances, and that participation was the most important factor influencing affective learning. Conclusions While our findings do not suggest that cognitive learning is strongly affected by social presence, implementing strategies to enhance social presence may improve the overall learning experience and make distance learning more enjoyable for students.     

Efficacy of Interactive Internet‐Based Education in Structural Timber Design

While traditional teaching methods (e.g., real‐time, synchronous lectures) have proven effective for training future engineers, the Internet provides an avenue to reinforce the material and augment student learning, comprehension, and retention of material. This paper presents the integration and assessment of a library of interactive instructional modules specifically for a senior‐level undergraduate elective course in civil engineering. An ongoing, comprehensive assessment process was implemented in the fall 1999 semester. The results of this quantitative assessment indicate that the use of well designed and pedagogically sound Internet‐based supplemental modules provide students with a better understanding of course material. However, when Internet‐based content does not promote critical thinking, little increase in the student performance and understanding of the material is realized. Interactive Web‐based instruction should not be viewed as a “replacement” to traditional instruction, but rather a tool that provides a broader and more dynamic environment for students with a variety of learning styles.     

Making the Grade with Students: The Case for Accessibility

Student‐based teaching evaluations are one critical component of instructor and course evaluation in most universities. The purpose of this study is to critically examine several factors that drive student‐based ratings of instructors and courses in an undergraduate mechanical engineering program. The findings are based on a statistical study of student ratings in 181 mechanical engineering courses during a three and one‐half year period, two mid‐semester classroom interviews, and anecdotal evidence garnered from personal experience. A key rating that appears strongly linked with the overall instructor and course rating is the “accessibility of the instructor.” The instructor accessibility factor outweighs others often cited by conventional wisdom, such as perceived course workload or expected grade in the course. Rationale for the strong correlation between instructor rating and perceived instructor accessibility is discussed. Several suggestions for how to improve instructor accessibility and resulting student‐based teaching evaluations are provided.     

Using Writing Assignments to Improve Self‐Assessment and Communication Skills in an Engineering Statics Course

This study explores the use of writing as a tool for metacognition in the engineering classroom. We used the “explain‐a‐problem” type of assignment in the Engineering Statics course for four terms. The objectives associated with the assignments were grouped under student self‐assessment, student communication, and administration. Performance on each of four grading criteria for each assignment was tracked throughout the terms. The data indicate that explain‐a‐problem does help students achieve the self‐assessment and communication objectives, although the impact on overall course performance was not as significant as hoped. The assignment evolved to the point that the administrative objectives were also met.     

The Relationship Between PDA Usage and Student Performance in an Introductory Engineering Course

This research focuses on the development of a methodology to evaluate student attitudes towards technology in the classroom and the impact of this technology on student learning. A survey was developed and tested to evaluate the impact of introducing Personal Digital Assistants (PDAs) in a traditional college classroom setting. PDAs were introduced in an introductory course in the College of Engineering at Oregon State University. A reliable attitude assessment tool was developed as a result of this research. Initial results of this study also provide empirical data that engineering students respond favorably to the introduction of PDAs in a traditional classroom setting. Preliminary results also provide limited evidence that student attitudes may vary based on gender, age, and/or ethnicity. Standard student performance metrics (course assignment and exam scores) and student self‐evaluations were used to assess the impact on student learning and are discussed.     

Perspectives on an Internet‐Based Synchronous Distance Learning Experience

This paper examines the distance learning process by providing an informed student's perspective as well as the instructor's perspective on an Internet‐based synchronous distance learning experience. Throughout the semester, the student maintained a class‐by‐class journal on his experiences and reactions to the Internet‐based course. This journal served as a crucial resource in the subsequent evaluation of the virtual classroom experience. The analysis provided in this paper, informed by current research on traditional and distance education, suggests that community, interaction, pedagogy, attention, and feedback play important roles in the success of an Internet‐based learning experience. Specific comments by the course instructor, as well as survey results from both students and other instructors for a number of synchronous Internet‐based courses, are also presented. This data further illuminates the student synchronous distance education experience and contributes additional insight into the delivery method and its ongoing evolution. The unique observations and conclusions provided here are useful for both instructors and students interested in participating in synchronous as well as asynchronous computermediated education.     

Integrating the Use of Commercial Simulators into Lecture Courses

Since commercial simulators are commonly used in the practice of engineering, we need to ensure they are included in engineering education. Computer laboratory sections were added to a “lecture” course to teach the use of a simulator and to give the students practice in solving realistic problems. By thinking about the computer lab as a problem‐based learning environment, minimal lecture time was necessary to train the students on the simulator. Examples of instructions, problem statements and results from a student survey are presented.     

Factors Influencing the Self‐Efficacy Beliefs of First‐Year Engineering Students

A survey incorporating qualitative measures of student self‐efficacy beliefs was administered to 1,387 first‐year engineering students enrolled in ENGR 106, Engineering Problem‐Solving and Computer Tools, at Purdue University. The survey was designed to identify factors related to students' self‐efficacy beliefs, their beliefs about their capabilities to perform the tasks necessary to achieve a desired outcome. Open‐ended questions prompted students to list factors affecting their confidence in their ability to succeed in the course. Students were then asked to rank these factors based on the degree to which their self‐efficacy beliefs were influenced. Gender trends emerged in student responses to factors that affect confidence in success. These trends are discussed in light of the categories identified by efficacy theorists as sources of self‐efficacy beliefs. The results presented here provide a useful look at the first‐year engineering experiences that influence students' efficacy beliefs, an important consideration in explaining student achievement, persistence, and interest.     

Kirkpatrick's Level 1 Evaluation of the Implementation of a Computer‐Aided Process Design Tool in a Senior‐Level Engineering Course

Computer simulation tools are frequently used in engineering design work, and undergraduates are often trained to use these tools as they learn to design systems. The use of new tools in the learning environment should be evaluated to assure that the students are able to use the tools effectively. This study details and demonstrates the use of a Kirkpatrick's Level 1 Evaluation to assess the effectiveness of an instructional environment in which students learn to use a computer simulation tool to perform engineering design work. Specifically, an evaluation was conducted to look at student perceptions of FOODS‐LIB—a steady‐state food process design tool, its user's manual learning modules, and the implementation of FOODS‐LIB in a senior level design course. This evaluation was triangulated with an instructor's assessment of student products generated as the students used the learning modules and designed an ice cream manufacturing process using FOODS‐LIB.     

Lessons Learned: Implementing the Case Teaching Method in a Mechanical Engineering Course

Background Case studies have been found to increase students' critical thinking and problem‐solving skills, higher‐order thinking skills, conceptual change, and their motivation to learn. Despite the popularity of the case study approach within engineering, the empirical research on the effectiveness of case studies is limited and the research that does exist has primarily focused on student perceptions of their learning rather than actual learning outcomes. Purpose (Hypothesis ) This paper describes an investigation of the impact of case‐based instruction on undergraduate mechanical engineering students' conceptual understanding and their attitudes towards the use of case studies. Design /Method Seventy‐three students from two sections of the same mechanical engineering course participated in this study. The two sections were both taught using traditional lecture and case teaching methods. Participants completed pre‐tests, post‐tests, and a survey to assess their conceptual understanding and engagement. Results Results suggested that the majority of participants felt the use of case studies was engaging and added a lot of realism to the class. There were no significant differences between traditional lecture and case teaching method on students' conceptual understanding. However, the use of case studies did no harm to students' understanding while making the content more relevant to students. Conclusions Case‐based instruction can be beneficial for students in terms of actively engaging them and allowing them to see the application and/or relevance of engineering to the real world.     

A Research Synthesis of the Effectiveness,Replicability, and Generality of the VaNTH Challenge‐based Instructional Modules in Bioengineering

Background Between 2000 and 2006 the Vanderbilt, Northwestern, Texas and Harvard/MIT Engineering Research Center (VaNTH/ERC) developed, tested, and implemented a set of educational innovations based largely on the ideas presented in the book How People Learn (HPL) and an instructional design known as the the STAR Legacy Cycle. The motivation for this study was to synthesize the results of this work. Published and unpublished experimental and quasi‐experimental assessments were included in this synthesis. Purpose (Hypothesis ) The fundamental hypotheses tested were whether a set of modules involving challenge‐based instruction and other course innovations, often involving advanced computer‐based technologies, improved student performance in a variety of educational settings and student populations, and whether improvements could be achieved by instructors other than the developers of the innovations. Design /Method Meta‐analysis of effects from thirty‐three separate modules in five courses in bioengineering domains was undertaken, along with three case studies. Results Results from the experimental (randomized) and stronger‐quasi experimental studies revealed a weighted effect size of 0.655 (p < 0.001). Studies using randomized designs produced smaller effects, and studies using measures of transfer and adaptive expertise to index outcomes produced larger effects. Analyses also revealed that the results can be replicated by instructors other than the developers of the modules, in a variety of student populations and educational settings, and at other institutions. Conclusions Overall, the challenge‐based modules and other innovations have moderate overall effects on improved student performance. They can be implemented successively by other instructors in a variety of educational settings and student populations.     

Implementation of Interdisciplinary Group Learning and Peer Assessment in a Nanotechnology Engineering Course

Nanotechnology is an inherently interdisciplinary field that has generated significant scientific and engineering interest in recent years. In an effort to convey the excitement and opportunities surrounding this discipline to senior undergraduate students and junior graduate students, a nanotechnology engineering course has been developed in the Department of Materials Science and Engineering at Northwestern University over the past two years. This paper examines the unique challenges facing educators in this dynamic, emerging field and describes an approach for the design of a nanotechnology engineering course employing the non‐traditional pedagogical practices of collaborative group learning, interdisciplinary learning, problem‐based learning, and peer assessment. Utilizing the same nanotechnology course given the year before as a historical control, analysis of the difference between measures of student performance and student experience over the two years indicates that these practices are successful and provide an educationally informed template for other newly developed engineering courses.     

An Interactive Database Supporting Virtual Fieldwork in an Environmental Engineering Design Project

This work presents an interactive simulation software package for delivering an environmental engineering design project. The primary goal of the effort is to supplement theory‐based course content with a complex and relevant design project, and to do so without increasing student course loads or placing excessive time demands on instructors. An additional goal for research‐based instructors is to provide an efficient mechanism for infusing current research findings and experimental techniques into the curriculum. The software that administers the design project is called Interactive Site Investigation Software (ISIS). This paper summarizes the rationale for the development of ISIS, outlines the instructor‐generated input required by ISIS, and details current ISIS features. These features allow students to drill boreholes, collect core samples, construct wells, collect groundwater samples, submit samples for laboratory analysis, and execute hydraulic and transport experiments at a virtual hazardous waste site. Initial feedback on the usability and usefulness of ISIS was generally positive, and the automated data requisition and dispensation substantially reduced the project's administrative demands on the instructor. Common student complaints pertained to controlled access to the software in the face of deadline pressure, uncertain expectations regarding their work product, and the need for real‐time advice.