Multidisciplinary or Interdisciplinary (99) Northwestern University's Searle Center for Teaching Excellence together with the City Colleges of Chicago (CCCs) are piloting a Science, Technology, Engineering, and Mathematics (STEM) faculty development program focused on improving higher order learning outcomes of STEM students. This pilot program consists of STEM faculty from two very different higher education institutions (a Private Research university and a large urban Community College and) with very different missions, faculty and student populations. Equal numbers of faculty from each institution participate in a linked series of workshops spanning one and a half academic years. This faculty development program is designed to assist STEM faculty in developing skills in critically reflecting on key issues in learning and teaching in higher education to improve STEM students' higher order learning outcomes. The project includes a rigorous evaluation plan to examine the effectiveness of the program both sites with respect to changes in (i) instructional and assessment practices, (ii) faculty approaches and conceptions of teaching, and (iii) student learning outcomes. In addition the effectiveness of this program is compared to the effectiveness of other Faculty Development programs. A unique model of faculty development is incorporated that goes beyond both traditional teaching-focused and student-focused conceptions and focuses on learning-centered conceptions and approaches to teaching. The program draws upon the latest research, scholarship and best practices on learning, teaching and faculty development. Participants design discipline-specific assessments based on the Critical Thinking Assessment Test (CAT), to collect data on their students' learning outcomes, across two successive cohorts, for the purpose of informing their teaching and ultimately improving their students' learning. The project addresses a very wide gap in the research and literature on the impact of STEM faculty development with respect to bringing about meaningful change in faculty teaching and, more importantly, in the higher order learning outcomes of their students and the national use of assessment in program and school accreditation. More immediate impacts include those on the higher order learning outcomes of undergraduate STEM students across a wide level of expertise and preparedness. The project's research findings and program model have the potential to impact STEM faculty and their students across the spectrum of higher education.

Project Report

Surveys and research studies across a wide range of fields consistently list critical thinking as one of the most important skills that employers are looking for in employees. Critical thinking includes skills like being able to evaluate evidence and identify inappropriate conclusions, separate factual information from inference, identify alternative explanations for data or observations and integrate information to solve a real world problem. The main goal of this project was to develop a program to help science, math and engineering instructors to be more effective teachers of critical thinking so that they can help their students become better critical thinkers. To achieve this goal, 9 instructors from the City Colleges of Chicago and 7 instructors from Northwestern University took part in a 2 year faculty development program on critical thinking led by staff from the Searle Center for Advancing Learning and Teaching at Northwestern University. The program consisted of a series of 7 interactive workshops and an experimental component in which the instructors conducted their own experiment on teaching critical thinking. In the first workshop, instructors learned about students’ critical thinking by scoring Critical Thinking Assessment Tests (CATs) that had been completed by students at their college or university. During the same workshop, the instructors used the CAT test questions as a model and designed their own questions for assessing critical thinking in one of their courses. Instructors began the experimental phase of the program by giving the CAT test and their own critical thinking assessment questions to one of their classes to measure the improvements that students made in critical thinking from the beginning to the end of the semester. They then attended a series of workshops in which they learned about barriers to critical thinking and designed new classroom activities to develop their students’ critical thinking. The next year that faculty taught their course, they used the new critical thinking activities and measured whether students made larger improvements on the CAT test and the course specific assessment questions than they had the previous year. Many instructors found that students achieved higher scores on their own assessments and some found that students also scored higher on the CAT test. Faculty met together at the end of the program to share their experience of introducing the new critical thinking activities into their classes and to reflect on the results of the experiment that they had conducted in their own classes. As a result of this project we have developed a bank of critical thinking assessment questions and activities that can be used and adapted by science, math and engineering instructors across the country. The critical thinking workshop materials are available for other colleges and universities and have already been used by Sierra Community College in California in an innovative program on critical thinking for their instructors and local high school teachers.

Agency
National Science Foundation (NSF)
Institute
Division of Undergraduate Education (DUE)
Type
Standard Grant (Standard)
Application #
0942404
Program Officer
Herbert H. Richtol
Project Start
Project End
Budget Start
2010-09-01
Budget End
2013-08-31
Support Year
Fiscal Year
2009
Total Cost
$229,629
Indirect Cost
Name
Northwestern University at Chicago
Department
Type
DUNS #
City
Evanston
State
IL
Country
United States
Zip Code
60201