This award funds research that uses empirical methods to test economic theories about the likely effects of quality disclosure programs. Such programs are designed to provide information to consumers about products or services that are difficult to evaluate. These programs are widely used by the government and by non-governmental certification agencies. They cover hospitals, schools, financial services, airline on-time performance, restaurant hygiene and others. Many of these programs present consumers with quality measures that are based on whether or not the quality of a product or a service passes a particular threshold (e.g., the percentage of a school?s students who passed a standardized test). One implication of designing disclosure programs in this way is that it may encourage firms to manipulate quality right around the relevant threshold. Another implication is that firms will have an incentive to engage in behavior that makes it easier for all of their products to pass the quality threshold.

This project investigates these implications using data from a from a specific quality disclosure program; government-mandated disclosure of airline on-time performance in the United States. This program reports the percentage of each airline?s flights that are less than fifteen minutes delayed upon arrival. The first part of our project focuses on the incentive to game flights that are near the program?s quality threshold. We begin by estimating the overall extent of gaming. Then, we study how the incentives for gaming changed after several airlines introduced bonus schemes which rewarded employees for improvements in reported performance. Lastly, we investigate whether gaming leads to inefficient resource allocation and to which extent it distorts the information that is conveyed to consumers. The second part of the project studies whether airlines reacted to the introduction of the disclosure program by increasing scheduled flight times or by moving flights to less congested times. Increasing scheduled flight times has no direct effect on reported quality, but makes it much easier to meet the fifteen minute threshold. However, lengthening schedules is costly because it reduces aircraft utilization and increases labor costs. We study how airlines trade off these costs against the benefit of improving their reported on-time performance. The advantage of this study?s setting over previous studies is that very rich data are available for airline on-time performance (with tens of millions of flights covered by the program) which allows us to compare airlines? behavior towards flights which are identical on many observable dimensions but differ in whether or not they are close to the fifteen minute threshold. Moreover, the program?s design implies that gaming tends to have a very different impact on flight delays than possible confounding factors. We can therefore rule out many alternative explanations for the observed behavior.

The broader impact of this research is to provide regulators with information about the responses of firms to a widely used form of quality disclosure regulation. Gaming of these programs is always a concern, and even more so when employees receive financial incentives that are based on the program?s rating scheme. Our study will be able to quantify the extent of gaming and how its impact on consumers.

Project Report

Quality disclosure programs are intended to provide consumers with information about credence goods. Many such programs present consumers with quality measures that are based on whether or not a product’s quality passes a particular threshold. One implication of designing a disclosure program in this way is that it may encourage firms to manipulate quality right around the relevant threshold. In the first project, we study this question in the context of disclosure of airline on-time performance, which ranks airlines based on the fraction of their flights that arrive less than 15 minutes late. We find that firms in this industry are heterogeneous in how they respond to these incentives. Some, but not all, firms make targeted efforts to have flights arrive with just under 15 minutes of delay. We find that internal firm characteristics, such as employee incentive programs and the firm’s choice to record delays manually or automatically, are correlated with the occurrence of manipulation around the 15 minute threshold. Our findings highlight the importance of interactions between incentives created by a disclosure program and firms’ internal organizational practices. In the second project, we study whether airlines adjust their flight schedules when they first become subject to the disclosure program. Since on-time performance is measured as the difference between actual and scheduled arrival time, firms can improve their reported performance by lengthening their scheduled flight time – even if there is no change in actual flight time. We study the behavior of three airlines as they become subject to the disclosure program. We find that the reporting requirement leads to a small but significant increase in scheduled flight times. These increases are concentrated on routes where the costs associated with lengthening schedules are relatively low.

Agency
National Science Foundation (NSF)
Institute
Division of Social and Economic Sciences (SES)
Type
Standard Grant (Standard)
Application #
1265481
Program Officer
Nancy Lutz
Project Start
Project End
Budget Start
2012-07-01
Budget End
2013-07-31
Support Year
Fiscal Year
2012
Total Cost
$60,060
Indirect Cost
Name
Case Western Reserve University
Department
Type
DUNS #
City
Cleveland
State
OH
Country
United States
Zip Code
44106