Mining Eye-Tracking Data for Text Summarization

Meirav Taieb-Maimon, Aleksandr Romanovski-Chernik, Mark Last, Marina Litvak, Michael Elhadad

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

In this study, we introduce and evaluate a novel extractive text summarization methodology, “SummarEyes,” based on the visual interaction of the user with the text, using eye-tracking data, as opposed to the traditional approaches based on analysis of textual content only. We conducted a large-scale user study aiming to collect eye-tracking data while reading the text to be summarized. We utilized various user’s implicit attention metrics to generate novel eye-tracking-based text summarization models and compared them both to eye-tracking models typically using only a single feature of the gaze duration and to traditional, as well as state-of-the-art summarization methods, based solely on textual features. The models’ quality was evaluated in terms of ROUGE scores using intrinsic evaluation on the datasets we had generated, relating gaze behavior to personalized and DUC gold-standard summaries. The experimental results showed that “SummarEyes” significantly outperformed the other summarizers in predicting both the user’s personalized summarization and the generic gold standard summaries. With the increasing availability of eye-tracking technology, this research can lead to a new generation of effective user-centric text summarization tools.

Original languageEnglish
JournalInternational Journal of Human-Computer Interaction
DOIs
StateAccepted/In press - 1 Jan 2023

Keywords

  • Text summarization
  • eye-tracking
  • implicit user feedback
  • machine learning
  • personalized summarization
  • user attention
  • user-oriented document summarization

ASJC Scopus subject areas

  • Human Factors and Ergonomics
  • Human-Computer Interaction
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Mining Eye-Tracking Data for Text Summarization'. Together they form a unique fingerprint.

Cite this