Comparison of Classification with Reject Option Approaches on MIMIC-IV Dataset.

Gerta Salillari, Nadav Rappoport

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This work compares two machine learning approaches that use the reject option method, i.e., the possibility to abstain from outputting a prediction in case the model is not confident about it, thus rejecting the sample. We demonstrated the usability of such a model for predicting patients’ mortality risk in ICU while maintaining an adequate level of accepted samples, using data from the MIMIC-IV database. Two strategies have been compared: a single-model classifier, trained to directly predict the mortality rate of a patient in ICU and rejecting the sample if the confidence of the model is below a certain threshold, and a double-model boosted classifier which considers training a preceding model for determining whether a sample is predictable, i.e. a model classifies if the sample is going to be correctly predicted, and, only if it is, a second model outputs a mortality prediction, otherwise the sample is rejected since its prediction will likely be random. The hypothesis is that the second strategy could give better results than the first one, considering a trade-off between the error rate and the amount of rejected samples. We found that the two models are confident about two different classes: the Classifier-only Model is more confident to include in its predictions and to classify ICU staying instances in which the patient deceases, whereas the Boosted Reject Option Model considers those cases more difficult to predict, thus rejects them.

Original languageEnglish
Title of host publicationArtificial Intelligence in Medicine - 20th International Conference on Artificial Intelligence in Medicine, AIME 2022, Proceedings
EditorsMartin Michalowski, Syed Sibte Raza Abidi, Samina Abidi
PublisherSpringer Cham
Pages210-219
Number of pages10
ISBN (Electronic)978-3-301-09342-5
ISBN (Print)978-3-031-09341-8
DOIs
StatePublished - 2022
Event20th International Conference on Artificial Intelligence in Medicine, AIME 2022 - Halifax, Canada
Duration: 14 Jun 202217 Jun 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13263 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th International Conference on Artificial Intelligence in Medicine, AIME 2022
Country/TerritoryCanada
CityHalifax
Period14/06/2217/06/22

Keywords

  • Artificial intelligence
  • Machine learning
  • Prediction models
  • Electronic Health Records
  • EHR

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science (all)

Fingerprint

Dive into the research topics of 'Comparison of Classification with Reject Option Approaches on MIMIC-IV Dataset.'. Together they form a unique fingerprint.

Cite this