With increasingly more medical tests and treatments being available, more patients being diagnosed with chronic diseases that require life-long management, and increasing pressure on clinicians to see more patients in a limited amount of time, it is essential that patients learn and understand how best to take care of their health. Unfortunately, an estimated 89 million people have insufficient health literacy to do just that and the associated costs are estimated to be into the billions of dollars each year. Although there are many exciting opportunities to educate consumers, ranging from visualization to virtual environments, text is still the most efficient and cost-effective medium available to all groups in society. Unfortunately, existing writing guidelines, relying heavily on readability formulas, have not been shown to impact text difficulty or consumer understanding. Objectives The objectives of this project are therefore to address and overcome existing barriers in current readability research. We address barriers as follows: we will work 1) with representative consumers, not experts evaluating on behalf of consumers, 2) using a large sample with thousands of participants working in their own settings, not a laboratory study with few participants in an artificial environment, and 3) evaluate both perceived and actual difficulty of text, two variables often confounded in studies, 4) to discover features that can be automatically discovered in text so that difficulty checkers can be developed that allow clinicians to efficiently and effectively optimize their text without requiring study of guidelines or linguistics. Design The study will be conducted using modern technology and resources. Over a time period of two years, master and doctoral level students will design and conduct the studies together with the principle investigator. The study brings together insights from computational linguistics and information science applied to medical informatics. Starting from a linguistic perspective, we will we systematically list good candidates of text features that may influence understanding. We will look at features of grammar, semantics, and compositions of text. By using a modern market place, Amazon's Mechanical Turk, we can involve thousands of participants in the study. We will each pair-wise comparisons of the features, e.g., sentences with high versus low topic density. Using a within-subjects design, we will measure perceived and actual difficulty of each feature with multiple choice question-answering tasks.

Public Health Relevance

Current health information is not attuned to the reading skills of consumers a situation that contributes to low health literacy and higher healthcare costs because of costly mistakes and unwise decisions. The proposed project will work with thousands of representative consumers to discover text features that influence perceived and actual difficulty of text. These features will lead to better writing guidelines and automated tools to help clinicians write health educational materials that are easier to understand and that are based on demonstrated impacts of the features on understanding.

National Institute of Health (NIH)
National Library of Medicine (NLM)
Small Research Grants (R03)
Project #
Application #
Study Section
Special Emphasis Panel (ZRG1-RPHB-A (50))
Program Officer
Vanbiervliet, Alan
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Claremont Graduate University
Other Domestic Higher Education
United States
Zip Code
Leroy, Gondy; Kauchak, David; Hogue, Alan (2016) Effects on Text Simplification: Evaluation of Splitting Up Noun Phrases. J Health Commun 21 Suppl 1:18-26
Leroy, Gondy; Kauchak, David (2014) The effect of word familiarity on actual and perceived text difficulty. J Am Med Inform Assoc 21:e169-72
Leroy, Gondy; Endicott, James E; Kauchak, David et al. (2013) User evaluation of the effects of a text simplification algorithm using term familiarity on perception, understanding, learning, and information retention. J Med Internet Res 15:e144
Leroy, Gondy; Kauchak, David; Mouradi, Obay (2013) A user-study measuring the effects of lexical simplification and coherence enhancement on perceived and actual text difficulty. Int J Med Inform 82:717-30
Leroy, Gondy; Endicott, James E; Mouradi, Obay et al. (2012) Improving perceived and actual text difficulty for health information consumers using semi-automated methods. AMIA Annu Symp Proc 2012:522-31
Leroy, Gondy; Endicott, James E (2011) Term Familiarity to indicate Perceived and Actual Difficulty of Text in Medical Digital Libraries. Digit Libraries Cult Herit Knowl Dissem Future Creat (2011) 7008:307-310