Purifying Data by Machine Learning with Certainty Levels

Shlomi Dolev, Guy Leshem

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

Abstract

For autonomic computing, self-managing systems, and decision-making under uncertainty and faults, in many cases we are using machine learning models and combine them to solve any problem. This models uses a data-set, or a set of data-items, and data-item is a vector of feature values and a classification. in many cases these data sets includes outlier and/or misleading data items that were created by input device malfunctions, or were maliciously inserted to lead the machine learning to wrong conclusions. A reliable machine learning model must be able to handle a corrupted data-set, otherwise, a malfunctioning input device that corrupts a portion of the data-set, or malicious adversary may lead to inaccurate classifications. Therefore, the challenge is to find an effective methods to evaluate and increase the certainty level of the learning process as much as possible. This work introduces the use of a certainty level measure to obtain better classification capability in the presence of corrupted or malicious data items. Assuming we know the data distribution, e.g., is a normal distribution (which is a reasonable assumption in a large amount of data items) and/or a known upper bound on the given number of corrupted data items, our techniques define a certainty level for classifications. Another approach that will be presented in this work suggests enhancing the random forest techniques (the original model was developed by Leo Breiman) to cope with corrupted data items by augmenting the certainty level for the classification obtained in each leaf in the forest. This method is of independent interest, that of significantly improving the classification of the random forest machine learning technique in less severe settings.

Original languageEnglish
Title of host publicationSpringer Optimization and Its Applications
Editors Goldengorin Boris, Kuznetsov Sergei
PublisherSpringer
Pages89-102
Number of pages14
ISBN (Electronic)978-3-031-31654-8
ISBN (Print)978-3-031-31653-1
DOIs
StatePublished - 1 Jan 2023

Publication series

NameSpringer Optimization and Its Applications
Volume202
ISSN (Print)1931-6828
ISSN (Electronic)1931-6836

Keywords

  • Certainty level
  • Data corruption
  • Machine learning
  • PAC learning

ASJC Scopus subject areas

  • Control and Optimization

Fingerprint

Dive into the research topics of 'Purifying Data by Machine Learning with Certainty Levels'. Together they form a unique fingerprint.

Cite this