Applying Judgment Analysis Theory and Methods: To Obtain an Insight into Clinical Judgments: Implementation and Findings with a Simulated Neonatal Intensive Care Unit Setup

Introduction: Clinicians who provide acute care are required to quickly identify and judge the illness severity of patients who experience deterioration in their clinical state. Accuracy of judgments can only be tested with respect to a valid reference, but in most health care areas, there is no such score. Judgment analysis theory and methods are presented and proposed as a framework to obtain insight into clinical judgments. A study in a simulated neonatal intensive care unit setup is described to demonstrate the applicability of the proposed methodology. Methods: Sixteen participants from a neonatal intensive care unit department reviewed 31 clips of simulated cases. The participants were directed to use a 5-point scale to rate their personal interpretation regarding the illness severity of the simulated patient. Judgment analysis techniques were used to identify the judgment capabilities of the participants and to determine factors that influence those capabilities. Results: Most participants interpreted the clinical signs information consistently, but interpretation varied remarkably between clinicians, providing possible explanation to the differences between the clinicians' judgments. Significant correlations were found between the doctors' years of medical experience and attributes of their judgments. Conclusions: Judgment analysis can be used to obtain insight into clinical judgments and to identify and quantify factors that affect clinicians' judgments. Judgment analysis can promote health care by enhancing clinical assessment teaching, by providing objective and personalized feedback to team members about their judgment performance, and by introducing a unified and objective method to study elements that affect clinical judgments.