Exploring the role of Large Language Models in haematology: A focused review of applications, benefits and limitations

Aya Mudrik, Girish N. Nadkarni, Orly Efros, Benjamin S. Glicksberg, Eyal Klang, Shelly Soffer

Research output: Contribution to journalReview articlepeer-review

7 Scopus citations

Abstract

Large language models (LLMs) have significantly impacted various fields with their ability to understand and generate human-like text. This study explores the potential benefits and limitations of integrating LLMs, such as ChatGPT, into haematology practices. Utilizing systematic review methodologies, we analysed studies published after 1 December 2022, from databases like PubMed, Web of Science and Scopus, and assessing each for bias with the QUADAS-2 tool. We reviewed 10 studies that applied LLMs in various haematology contexts. These models demonstrated proficiency in specific tasks, such as achieving 76% diagnostic accuracy for haemoglobinopathies. However, the research highlighted inconsistencies in performance and reference accuracy, indicating variability in reliability across different uses. Additionally, the limited scope of these studies and constraints on datasets could potentially limit the generalizability of our findings. The findings suggest that, while LLMs provide notable advantages in enhancing diagnostic processes and educational resources within haematology, their integration into clinical practice requires careful consideration. Before implementing them in haematology, rigorous testing and specific adaptation are essential. This involves validating their accuracy and reliability across different scenarios. Given the field's complexity, it is also critical to continuously monitor these models and adapt them responsively.

Original languageEnglish
Pages (from-to)1685-1698
Number of pages14
JournalBritish Journal of Haematology
Volume205
Issue number5
DOIs
StatePublished - 1 Nov 2024

Keywords

  • ChatGPT
  • Google Bard
  • Large Language Models
  • Microsoft Bing
  • PaLM
  • haematology

ASJC Scopus subject areas

  • Hematology

Fingerprint

Dive into the research topics of 'Exploring the role of Large Language Models in haematology: A focused review of applications, benefits and limitations'. Together they form a unique fingerprint.

Cite this