This proposal explores how individuals decide what online information to trust given the uncertain information they often encounter. In today's society, life experiences are often processed in an online world. Online resources provide information and support for parenting, health, hobbies, news, and more. However, online resources are often incomplete, may include a diversity of opinions, and may be inaccurate. In a connected series of research studies exploring general theoretical questions, this project focuses on a compelling and common example of uncertainty online - the uncertainty about treatments for a chronic health condition. Chronic disease is a leading cause of ill health world wide, and one in ten Americans lives with a life-altering chronic condition. Unlike acute conditions (such as a high fever), chronic conditions, such as HIV, diabetes, arthritis, and Lyme disease, are prolonged and rarely cured completely. For this reason, management of chronic conditions lies much more in the hands of the patient.

This research will study online health resources and individuals' use of these online resources using interview data, survey data, and text analysis of thousands of pages and posts available in online content. First, it will characterize the uncertainty of different types of online resources. Second, it will focus on how uncertainty impacts a specific community characterized by highly uncertain and even controversial information about the disease process and treatment (the Lyme disease community). And third, the research will test the generalizability of results in a complementary setting (such as individuals with chronic arthritis). The empirical work will answer the following questions: 1) How does the existence of incomplete, divergent and/or conflicting information affect the health choices made by individuals with chronic illness? 2) What factors (community, time, exposure to information) are critical to an individual with chronic illness deciding whether to believe in a specific viewpoint?

The results will drive the design of two technological interventions that can improve people's ability to understand and decide among online resources: (1) A tool to extract and highlight key parameters of decision making derived from the research, that will crawl relevant sources and extract information such as patient consensus, medical research timeline, and risks. (2) A tool to classify online resources in terms of viewpoint, leveraging machine-learning techniques such as co-training to learn classifications on the fly. The second tool will inform the first, but also provide an interface for sorting and filtering online information and compare the information cloud associated with different viewpoints. The results of this research will add to existing knowledge about how the Internet can support individuals with chronic conditions, and contribute to the development of curriculum for courses on human-computer interaction in the medical area.

Project Report

Chronic illness is defined as an illness or disease that is long-term or permanent, as opposed to acute. For many individuals living with a chronic condition, the web has served as an important medium for researching treatment options, developing a support network, and sharing information and experiences with others. Our purpose is to learn about how individuals with chronic illness, and their caregivers, use resources available online. Such resources include sites offering medical information as well as research and experience blogs, forums, and others. Our first studies focused on individuals with Lyme disease. Because Lyme disease is disputed in both diagnosis and treatment methods among healthcare professionals, individuals with Lyme disease depend on online advocacy and activism to manage their condition. At the same time, divergent and conflicting information is common online. How does this affect the experience and outcomes for individuals with Lyme disease? We found that the resources our participants used included interpersonal email, community resources (support groups, live group chat, and mailing lists), content (research articles, organizational websites, medical portals, Wikipedia, etc.), blogs (read and/or written by participants), symptom tracking applications, and medical record sites. While many of the ways in which our participants used online content reflected known practices, there were some important discrepancies that were driven by the conflicts associated with Lyme disease. In addition to studies of Lyme disease, we have conducted a series of studies exploring other situations that have similar properties. For example, we conducted a series of interviews and design explorations with individuals with diabetes. We identified ways in which the care network fails these individuals and developed a framework for social support that could help connect patients with caregivers at the time of diagnosis. We also looked at the sharing of controversial digital photos online. We explored the perceived risk of publishing these photos, and the ways in which people protected for and advocated for the rights of others. Our findings point to ways in which photo sharing resources can support identity building and simultaneously be considerate of user’s concerns about the privacy of themselves and others. Lastly, we began investigating how individuals with disabling chronic conditions work together to ensure that the content they produce online is accessible. For example, we found individuals with lyme disease and difficulty reading complex content self-mediating the content of forum posts. We also explored accessible content creation on Wikipedia. This work was published as a poster in ASSETS 2009 and at CHI 2013 as a full paper. A second goal of our grant was to develop tools supporting individuals with chronic illness online. We have developed machine learning algorithms for estimating the degree of experiential and/or informational content in a post. A number of past works have explored how properties of websites (and especially, peer communication sites) affect consumer trust. However very little is known about properties of information seekers that affect what they trust, specifically how people differ in their trust of peer-produced content and why. We have developed an interface to a popular support group that shows users how experiential or informational a thread is, and have preliminary results from a study exploring the impact of this information on participant behavior. Our work also uncovered the importance of online content being accessible, a particular problem when it is produced by end users. We studied how groups of end users work together to create a community culture of accessible content creation. We found that moderation has the capacity to encourage new users to produce more cognitively accessible content. However, this approach may frustrate a user, or be ignored. We also found that moderating posts are one piece of the puzzle in a community’s successful commitment to cognitive accessibility. They may create a culture in which users indirectly and directly encourage others to increase the cognitive accessibility of content.

Agency
National Science Foundation (NSF)
Institute
Division of Information and Intelligent Systems (IIS)
Type
Standard Grant (Standard)
Application #
0916459
Program Officer
William Bainbridge
Project Start
Project End
Budget Start
2009-09-01
Budget End
2013-08-31
Support Year
Fiscal Year
2009
Total Cost
$532,079
Indirect Cost
Name
Carnegie-Mellon University
Department
Type
DUNS #
City
Pittsburgh
State
PA
Country
United States
Zip Code
15213