Abstract
Inter-observer agreement is essential to medical staff members and has a major effect on communication. The goal of the study was to examine the way medical professionals evaluate the potential severity of Almost Adverse Events (AAEs) that were observed in two intensive care units (ICUs). One hundred and fourteen AAEs were observed and recorded in both units by engineering students. Each AAE was rated independently by five senior medical staff members from each ICU, chosen by the unit manager, on a three- point severity level scale. Statistical analysis (K statistic and Cohen's Kappa) yielded relatively low levels of agreement among raters in both ICUs (< 0.3), but significantly greater agreement was found among nurses than among physicians in both ICUs. Low levels of agreement are attributed to the nature of work and characteristics of each ICU. Recommendations for improving agreements including forming shared mental models are specified.
Original language | English |
---|---|
Pages (from-to) | 357-366 |
Number of pages | 10 |
Journal | Journal of Healthcare Engineering |
Volume | 1 |
Issue number | 3 |
DOIs | |
State | Published - 1 Jan 2010 |
Keywords
- Almost adverse events
- Communication
- Inter-observer agreement
- Kappa coefficients
- Mental model
ASJC Scopus subject areas
- Biotechnology
- Surgery
- Biomedical Engineering
- Health Informatics