The project on the design of realistic uncheatable benchmarks strives to achieve a more sophisticated design methodology of computer performance benchmarks, based on the theory of computational complexity. The goal is to integrate ideas from randomization and cryptography with realistic existing benchmark in everyday use. There has been tremendous progress in theoretical computer science in recent years, especially with regard to the power of randomization and interaction. These ideas are well suited to the design of uncheatable benchmarks. The purpose of benchmark testing is to estimate the performance and reliability of hardware and software systems. By and large existing benchmark design has focused on "typical" programs and data sets for the system. The problem of making benchmarks resistant to tampering has been mostly ignored. The on-going research in this project has demonstrated the feasibility of applying ideas from computational complexity and cryptography to a wide variety of existing benchmarks, and making them more accurate, resistant to tampering and thus more trustworthy.***

Agency
National Science Foundation (NSF)
Institute
Division of Computer and Communication Foundations (CCF)
Type
Standard Grant (Standard)
Application #
9634665
Program Officer
Anand R. Tripathi
Project Start
Project End
Budget Start
1996-09-01
Budget End
2000-08-31
Support Year
Fiscal Year
1996
Total Cost
$242,237
Indirect Cost
Name
Suny at Buffalo
Department
Type
DUNS #
City
Buffalo
State
NY
Country
United States
Zip Code
14260