Physicians have many questions when seeing patients. Primary care physicians are reported to generate between 0.7 and 18.5 questions for every 10 patient visits. The published medical literature is an important resource helping physicians to access up-to-date clinical information and thereby to enhance the quality of patient care. For example, the case study in the above example (i.e., diagnostic procedures and treatment for cellulites) was published in a """"""""Clinical Practice"""""""" article in the New England Journal of Medicine (NEJM). Although PubMed is frequently used by physicians in large hospitals, it does not return answers to specific questions. Frequently, PubMed returns a large number of articles in response to a specific user query. Physicians have limited time for browsing the articles retrieved;it has been found that physicians spend on average two minutes or less seeking an answer to a question, and that if a search takes longer it is likely to be abandoned. An evaluation study has shown that it takes an average of more than 30 minutes for a healthcare provider to search for answer from PubMed, which makes """"""""information seeking ... practical only `after hours'and not in the clinical setting."""""""" It has been concluded that a lack of time is the most common obstacle resulting in many unanswered medical questions. The importance of answering physicians'questions at the point of patient care has been widely recognized by the medical community. Many medical databases (e.g., UpToDate and Thomson MICROMEDEX) provide summaries to answer important medical questions related to patient care. However, most of the summaries are written by medical experts who manually review the literature information. The databases are limited in their scope and timeliness. We hypothesize that we can develop medical language processing (MLP) approaches to build a fully automated system HERMES - Help physicians to Extract and aRticulate Multimedia information from literature to answer their ad-hoc medical quEstionS. HERMES will automatically retrieve, extract, analyze, and integrate text, image, and video from the literature and formulate them as answers to ad-hoc medical questions posed by physicians. Our preliminary results show that even a limited HERMES working system outperformed other information retrieval systems and can generate answers within a timeframe necessary to meet the demands of physicians. HERMES promise to assist physicians for practicing evidence-based medicine (EBM), the medical practice that involves the explicit use of current best evidence, i.e., high-quality patient-centered clinical research reported in the primary medical literature.
Our specific aims are: 1) Identify information needs from ad-hoc medical questions. We will incorporate rich semantic, statistical, and machine learning approaches to map ad-hoc medical questions to their component question types automatically. A component question type is a generic, simple question type that requires an answer strategy that is different from other component question types. 2) Develop new information retrieval models that integrate domain-specific knowledge for retrieving relevant documents in response to an ad-hoc medical question. 3) Extract relevant text, images, and videos from the retrieved documents in response to an ad-hoc medical question. 4) Integrate text, images, and videos, fusing information to generate a short and coherent multimedia summary. 5) Design a usability study to measure efficacy, accuracy and perceived ease of use of HERMES and to compare HERMES with other information systems.

Agency
National Institute of Health (NIH)
Institute
National Library of Medicine (NLM)
Type
Research Project (R01)
Project #
3R01LM009836-02S1
Application #
7908952
Study Section
Biomedical Computing and Health Informatics Study Section (BCHI)
Program Officer
Sim, Hua-Chuan
Project Start
2009-09-30
Project End
2010-09-29
Budget Start
2009-09-30
Budget End
2010-09-29
Support Year
2
Fiscal Year
2009
Total Cost
$170,662
Indirect Cost
Name
University of Wisconsin Milwaukee
Department
Other Health Professions
Type
Schools of Allied Health Profes
DUNS #
627906399
City
Milwaukee
State
WI
Country
United States
Zip Code
53201
Bockhorst, Joseph P; Conroy, John M; Agarwal, Shashank et al. (2012) Beyond captions: linking figures with abstract sentences in biomedical articles. PLoS One 7:e39618
Cao, YongGang; Liu, Feifan; Simpson, Pippa et al. (2011) AskHERMES: An online question answering system for complex clinical questions. J Biomed Inform 44:277-88
Agarwal, Shashank; Liu, Feifan; Yu, Hong (2011) Simple and efficient machine learning frameworks for identifying protein-protein interaction relevant articles and experimental methods used to study the interactions. BMC Bioinformatics 12 Suppl 8:S10
Liu, Feifan; Tur, Gokhan; Hakkani-Tur, Dilek et al. (2011) Towards spoken clinical-question answering: evaluating and adapting automatic speech-recognition systems for spoken clinical questions. J Am Med Inform Assoc 18:625-30
Agarwal, Shashank; Yu, Hong (2011) Figure summarizer browser extensions for PubMed Central. Bioinformatics 27:1723-4
Liu, Feifan; Antieau, Lamont D; Yu, Hong (2011) Toward automated consumer question answering: automatically separating consumer questions from professional questions in the healthcare domain. J Biomed Inform 44:1032-8
Zhang, Qing; Cao, Yong-Gang; Yu, Hong (2011) Parsing citations in biomedical articles using conditional random fields. Comput Biol Med 41:190-4
Lu, Zhiyong; Kao, Hung-Yu; Wei, Chih-Hsuan et al. (2011) The gene normalization task in BioCreative III. BMC Bioinformatics 12 Suppl 8:S2
Agarwal, Shashank; Yu, Hong; Kohane, Issac (2011) BioNOT: a searchable database of biomedical negated sentences. BMC Bioinformatics 12:420
Krallinger, Martin; Vazquez, Miguel; Leitner, Florian et al. (2011) The Protein-Protein Interaction tasks of BioCreative III: classification/ranking of articles and linking bio-ontology concepts to full text. BMC Bioinformatics 12 Suppl 8:S3

Showing the most recent 10 out of 22 publications