Current sample size methods for multilevel and longitudinal data often get the wrong answer. Studies that are too small cannot achieve scientific goals. Studies that are too large expose human research participants to unnecessary harm. The ethical codes that bind NIH funded behavioral scientists doing research with human participants demand correct sample size selection. Flaws of current sample size methods are a critical barrier to progress. Behavioral scientists use community trials, longitudinal data, and multilevel models to compare diverse populations. Understanding addiction and gauging knowledge about head and neck cancer screening require measuring outcomes over time. The complex data yield complex variance patterns. Current software (such as Optimal Design) makes simplifying assumptions about the variance patterns, which may lead to the wrong sample size. No available software always gives the correct sample size analysis;the existing paradigm fails. There are three barriers to progress in designing multilevel and longitudinal studies: 1) inadequate tools to evaluate when current sample size methods fail;2) flawed methods and software to select sample size;and 3) insufficient training to find correct sample sizes. The successful completion of two aims will remove the three barriers.
The aims are 1) Create new sample size methods and software needed to accurately mirror multilevel and longitudinal models of normal, binary, and Poisson data common in studying health behavior in diverse populations and 2) Train behavioral scientists to use the new methods and software. Training will include template sample size analyses, tutorial publications, short courses, webinars and online tutorials. Better sample size calculations will produce better designed studies. Better designed studies will speed ethical, efficient, and effective behavioral research. Behavioral research lies at the heart of preventing addiction and cancer. Correct sample size selection is not merely a statistical nicety. The new methods will directly improve the health of millions of Americans.
The ethics and cost of human research demands accurate sample size. Current sample size selection methods can fail with multilevel and longitudinal data. We will develop new sample size tools for behavioral scientists conducting prevention research in communities with diverse populations.
Showing the most recent 10 out of 18 publications