Prediction and explainability in AI: Striking a new balance?

Aviad Raz, Bert Heinrichs, Netta Avnoon, Gil Eyal, Yael Inbar

Research output: Contribution to journalComment/debate

Abstract

The debate regarding prediction and explainability in artificial intelligence (AI) centers around the trade-off between achieving high-performance accurate models and the ability to understand and interpret the decisionmaking process of those models. In recent years, this debate has gained significant attention due to the increasing adoption of AI systems in various domains, including healthcare, finance, and criminal justice. While prediction and explainability are desirable goals in principle, the recent spread of high accuracy yet opaque machine learning (ML) algorithms has highlighted the trade-off between the two, marking this debate as an inter-disciplinary, inter-professional arena for negotiating expertise. There is no longer an agreement about what should be the “default” balance of prediction and explainability, with various positions reflecting claims for professional jurisdiction. Overall, there appears to be a growing schism between the regulatory and ethics-based call for explainability as a condition for trustworthy AI, and how it is being designed, assimilated, and negotiated. The impetus for writing this commentary comes from recent suggestions that explainability is overrated, including the argument that explainability is not guaranteed in human healthcare experts either. To shed light on this debate, its premises, and its recent twists, we provide an overview of key arguments representing different frames, focusing on AI in healthcare.

Original languageEnglish
JournalBig Data and Society
Volume11
Issue number1
DOIs
StatePublished - 1 Jan 2024

Keywords

  • Artificial intelligence – AI
  • evidence-based medicine
  • explainable AI – XAI
  • healthcare
  • predictability
  • transparency

ASJC Scopus subject areas

  • Information Systems
  • Communication
  • Computer Science Applications
  • Information Systems and Management
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'Prediction and explainability in AI: Striking a new balance?'. Together they form a unique fingerprint.

Cite this