Research and Assessment (89) and Engineering - Other (59) As noted in an influential National Academy of Engineering assessment, two skill attributes of engineers that are of growing importance are the ability to use science and practical ingenuity to identify problems and solve them and very strong analytical skills (The Engineer of 2020: Visions for Engineering in a New Century, National Academy Press, 2004). This project is working to develop these attributes in undergraduate engineering programs in the foundational area of thermodynamics. The project's initial step is research into the ability of students to function effectively in this area, building on research that the same team of engineers and educational psychologists has recently completed in engineering mechanics - specifically statics. The research in this project will be augmented by designing educational interventions and the creation of an assessment tool focused on student ability to problem solve in thermodynamics.

The research focuses on the modeling steps in thermodynamics problem solving that require students to read the problem, to abstract a model of the system to be analyzed, typically a thermodynamic process plot or an energy-flow diagram, and then to create a mathematical model of the system using process descriptors and state relations or applying energy conservation. The first step in the research is addressing the questions: "What major difficulties do students encounter in solving problems in thermodynamics?" and "Can what students know about free-body diagrams be used as scaffolding to develop skills in creating energy flow or process diagrams?"

To explore these questions, written and verbal protocols are being developed by the team, guided by its work in statics and the extensive published literature on this subject. The results of this work are intended for use in designing initial interventions to improve students' problem-solving abilities. These initial interventions will be piloted and refined. The assessment instruments and interventions are being designed to be suitable for large-scale use, evaluation, and dissemination. Among the methods planned for disseminating the results of this project is the use of the Cambridge University Press's website for worldwide dissemination.

Project Report

Thermodynamics is the science of energy transformations. For example, thermodynamics deals with how the energy stored in the chemical bonds of fossil fuels is transformed to mechanical power produced by a steam turbine, which, in turn, is transformed into electricity for everyday use. Most undergraduate engineering students are required to take a course in thermodynamics, and many of these students struggle to learn this foundational subject. The goal of this project was to understand students’ difficulties with this subject and to provide teaching tools that facilitate student learning. A major outcome of the project was the development and assessment of a Thermodynamics Concept Reasoning Inventory (TCRI). This differs from traditional concept inventories in that it attempts to assess how well students understand and can connect thermodynamics concepts, i.e., can students reason with the thermodynamic tools in their toolbox? The Thermodynamics Concept-Reasoning Inventory (TCRI) consists of 36 multiple-choice items. None of the items requires any numerical calculations. Thirty-four of the items are paired questions and justifications. An outside-expert review supported the ideas that the TCRI (i) focuses on important concepts in thermodynamics, (ii) requires conceptual reasoning as opposed to recall, (iii) the correct justification statements demonstrate appropriate conceptual reasoning for beginning thermodynamic students, and (iv) the incorrect justifications include common errors made by my students. The TCRI was administered to 435 students, which allowed us to assess its internal consistency and its ability to discriminate good performers from poor performers. Statistical evidence shows that the TCRI scores highly in both of these measures. Our Thermodynamics Concept-Reasoning Inventory (TCRI) will be available to engineering educators in the US and around the world. A second outcome of the project was the development of an intervention to improve students' reasoning and problem-solving abilities in thermodynamics. Our intervention consists of three exercises and a sequence of short videos. The intervention was designed to stimulate students’ organization, elaboration, and regulation during problem solving. The ability to organize concepts and elaborate how these concepts relate to one another is critical to developing conceptual understanding, as opposed to pure rote learning. We used the Thermodynamics Concept-Reasoning Inventory (TCRI) in a controlled experiment to evaluate the effectiveness of our organization-elaboration-regulation (OER-Thermo) intervention. Results showed that pre-test to post-test gain scores for the students who completed the intervention were significantly greater than the gain score for the control group. The difference between the two groups was both statistically significant, with a high degree of confidence, and approached a large effect. We found that students were highly motivated and engaged in the subject matter when completing the exercises and viewing the videos. Student comments overwhelmingly showed that the students found the intervention helpful to their learning thermodynamics. Results from think-aloud studies provide support for the hypothesis that the OER-Thermo intervention stimulates organization, elaboration, and regulation and, thereby, significantly improves students’ ability to solve thermodynamics problems. With energy issues currently so important, having students interested in thermodynamics and capable to work in this area is a worthy societal goal. Our work is a step toward achieving this goal. Our OER-Thermo intervention (exercises and videos) is available to the public at www.youtube.com/user/psuthermo?feature=. We believe that the concept of using targeted exercises that incorporate organization, elaboration, and regulation can be applied to many other disciplines, particularly the science, technology, engineering, and mathematics (STEM) disciplines.

Agency
National Science Foundation (NSF)
Institute
Division of Undergraduate Education (DUE)
Type
Standard Grant (Standard)
Application #
1043833
Program Officer
Myles Boylan
Project Start
Project End
Budget Start
2011-02-15
Budget End
2013-06-30
Support Year
Fiscal Year
2010
Total Cost
$200,000
Indirect Cost
Name
Pennsylvania State University
Department
Type
DUNS #
City
University Park
State
PA
Country
United States
Zip Code
16802