This project will determine whether the well-described paradigm of the model-tracing Intelligent Tutoring System can be adapted to create a multimedia, knowledge-based, medical training system in Pathology. Intelligent Tutoring Systems (ITS) are computer-based systems that provide individualized instruction by incorporating models of expert performance and dynamically building a unique student model for each user. ITS can be highly effective in systems that simulate real-world tasks, enabling students to work through case based scenarios as the ITS offers guidance, points out errors and organizes the curriculum to address the needs of that individual learner. We propose to implement and evaluate such a system in Dermatopathology - the pathology of skin disease. The methodology to be used is grounded in a theory of human skill acquisition that has been widely tested. We will utilize a rule-and-frame expert model guided by our previous work describing the development of visual diagnostic expertise in Pathology. The system will incorporate a Virtual Microscope simulation, and access a library of whole-slide digital images. System development will be accompanied by a set of formative evaluations in which we will specifically compare alternatives for maximizing educational impact, and explore the design issues most critical for adapting the ITS paradigm into a medical domain. Key areas of research during the formative evaluation include: (1) examination of immediate feedback versus post-case critiquing, (2) evaluation of alternative methods for student modeling, and (3) the testing of interfaces for reifying diagnostic problem solving. During the final years of the project, our efforts will be directed towards summative evaluation of the effect of the composite system, in laboratory and field studies.

Agency
National Institute of Health (NIH)
Institute
National Library of Medicine (NLM)
Type
Research Project (R01)
Project #
5R01LM007891-02
Application #
6754402
Study Section
Biomedical Library and Informatics Review Committee (BLR)
Program Officer
Florance, Valerie
Project Start
2003-06-01
Project End
2007-05-31
Budget Start
2004-06-01
Budget End
2005-05-31
Support Year
2
Fiscal Year
2004
Total Cost
$273,316
Indirect Cost
Name
University of Pittsburgh
Department
Pathology
Type
Schools of Medicine
DUNS #
004514360
City
Pittsburgh
State
PA
Country
United States
Zip Code
15213
Feyzi-Behnagh, Reza; Azevedo, Roger; Legowski, Elizabeth et al. (2014) METACOGNITIVE SCAFFOLDS IMPROVE SELF-JUDGMENTS OF ACCURACY IN A MEDICAL INTELLIGENT TUTORING SYSTEM. Instr Sci 42:159-181
Crowley, Rebecca S; Legowski, Elizabeth; Medvedeva, Olga et al. (2013) Automated detection of heuristics and biases among pathologists in a computer-based system. Adv Health Sci Educ Theory Pract 18:343-63
Mello-Thoms, Claudia; Mello, Carlos A B; Medvedeva, Olga et al. (2012) Perceptual analysis of the reading of dermatopathology virtual slides by pathology residents. Arch Pathol Lab Med 136:551-62
El Saadawi, Gilan M; Azevedo, Roger; Castine, Melissa et al. (2010) Factors affecting feeling-of-knowing in a medical intelligent tutoring system: the role of immediate feedback as a metacognitive scaffold. Adv Health Sci Educ Theory Pract 15:9-30
Payne, Velma L; Medvedeva, Olga; Legowski, Elizabeth et al. (2009) Effect of a limited-enforcement intelligent tutoring system in dermatopathology on student errors, goals and solution paths. Artif Intell Med 47:175-97
El Saadawi, Gilan M; Tseytlin, Eugene; Legowski, Elizabeth et al. (2008) A natural language intelligent tutoring system for training pathologists: implementation and evaluation. Adv Health Sci Educ Theory Pract 13:709-22
Crowley, Rebecca S; Legowski, Elizabeth; Medvedeva, Olga et al. (2007) Evaluation of an intelligent tutoring system in pathology: effects of external representation on performance gains, metacognition, and acceptance. J Am Med Inform Assoc 14:182-90
Crowley, Rebecca S; Medvedeva, Olga (2006) An intelligent tutoring system for visual classification problem solving. Artif Intell Med 36:85-117
Saadawi, Gilan M; Legowski, Elizabeth; Medvedeva, Olga et al. (2005) A method for automated detection of usability problems from client user interface events. AMIA Annu Symp Proc :654-8
Crowley, Rebecca S; Medvedeva, Olga (2003) A general architecture for intelligent tutoring of diagnostic classification problem solving. AMIA Annu Symp Proc :185-9