Classifier evaluation under limited resources

Reuven Arbel, Lior Rokach

Research output: Contribution to journalArticlepeer-review

13 Scopus citations


Existing evaluations measures are insufficient when probabilistic classifiers are used for choosing objects to be included in a limited quota. This paper reviews performance measures that suit probabilistic classification and introduce two novel performance measures that can be used effectively for this task. It then investigates when to use each of the measures and what purpose each one of them serves. The use of these measures is demonstrated on a real life dataset obtained from the human resource field and is validated on set of benchmark datasets.

Original languageEnglish
Pages (from-to)1619-1631
Number of pages13
JournalPattern Recognition Letters
Issue number14
StatePublished - 15 Oct 2006


  • Classification
  • Evaluation measures
  • Hit-rate
  • Recall
  • Receiver operating characteristic

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Classifier evaluation under limited resources'. Together they form a unique fingerprint.

Cite this