Understanding public opinion is one of the fundamental issues in political science and of key import in any democracy. National surveys are designed to produce good estimates of national public opinion, but not necessarily to give good estimates at the state or congressional district level or by finely-grained demographic sub-groups. Therefore usually knowledge of public opinion at these more local levels is lacking despite the fact that much important policymaking and politics is at these levels. This seriously limits the preference measures social scientists can employ, with real consequences for research into opinion formation, opinion dynamics, and government responsiveness. This project further develops and automates a technique known as multilevel regression and post-stratification (MRP) that allows for national surveys and publicly available Census data to be used to estimate public opinion sub-nationally.

While the methodological and substantive potential of MRP has been established, it has not yet been advanced to its full potential either in usage or scope. This project enables several significant extensions. These include making the MRP method itself far more accessible to a broad range of researchers and poll analysts, by automating and routinizing the process, so that others can create estimates from their own data. Robustness checks and measures of uncertainty are developed and made part of the automated process. In addition, diagnostics are created to show if the method is working properly in a particular setting.

The proposed research will promote the progress of science and the national welfare by: 1) Contributing to the growing literature on the role of public opinion in government policymaking and the degree to which majority will is represented, or, conversely, the degree to which non-majority groups prevail. 2) Developing statistical tools and methods for the study of policy responsiveness. 3) Involving undergraduate and graduate students in the conduct of our research. 4) Disseminating results to the academic community through conference presentations, journal articles, and other publications. 5) Disseminating results to the non-academic community through the mass media and through presentations to non-profit and civic organizations fostering democratic engagement and greater policy responsiveness from government agencies.

Project Report

National surveys are designed to provide good estimates of national public opinion, but do not necessarily provide good estimates of opinion by subnational units of government---states, congressional districts, state legislative districts, cities, etc. This means that, absent conducting hundreds or even thousands of individual polls, social scientists, journalists, and elected officials often lack good data about public preferences at the subnational level. This project developed new statistical techniques for doing so. These techniques, called multilevel regression and poststratification (MRP), use national surveys and detailed data from the U.S. Census to simulate public opinion across subnational governmental units. The researchers carefully demonstrate that MRP, if properly implemented, can generate accurate measures of public opinion. The researchers have also developed and made public a software package that automates MRP, allowing for widespread dissemination of these research tools. MRP has greatly increased scholars ability to measure and study preferences at the subnational level. Indeed, a number of graduate students and researchers in a variety of social science disciplines have already adopted the techniques developed in this project. The researchers also employed the statistical tools they developed to make substantive contributions to social science research. The results of this work have been published in top political science and methodology journals as well as the New York Times. The main substantive work uses MRP to estimate public preferences across a variety of issues and then investigates the extent to which government responds to public preferences. Researchers find that government is less responsive to public opinion that political science had previously thought. They also find that institutions such as professionalized legislatures and term limits are associated with higher levels of responsiveness. Governments also seem to respond more to public opinion on highly salient public policy issues.

Agency
National Science Foundation (NSF)
Institute
Division of Social and Economic Sciences (SES)
Application #
1023189
Program Officer
Brian D. Humes
Project Start
Project End
Budget Start
2010-10-01
Budget End
2014-09-30
Support Year
Fiscal Year
2010
Total Cost
$300,000
Indirect Cost
Name
Columbia University
Department
Type
DUNS #
City
New York
State
NY
Country
United States
Zip Code
10027