Using machine learning to disentangle homonyms in large text corpora

Uri Roll, Ricardo A. Correia, Oded Berger-Tal

Research output: Contribution to journalArticlepeer-review

33 Scopus citations

Abstract

Systematic reviews are an increasingly popular decision-making tool that provides an unbiased summary of evidence to support conservation action. These reviews bridge the gap between researchers and managers by presenting a comprehensive overview of all studies relating to a particular topic and identify specifically where and under which conditions an effect is present. However, several technical challenges can severely hinder the feasibility and applicability of systematic reviews, for example, homonyms (terms that share spelling but differ in meaning). Homonyms add noise to search results and cannot be easily identified or removed. We developed a semiautomated approach that can aid in the classification of homonyms among narratives. We used a combination of automated content analysis and artificial neural networks to quickly and accurately sift through large corpora of academic texts and classify them to distinct topics. As an example, we explored the use of the word reintroduction in academic texts. Reintroduction is used within the conservation context to indicate the release of organisms to their former native habitat; however, a Web of Science search for this word returned thousands of publications in which the term has other meanings and contexts. Using our method, we automatically classified a sample of 3000 of these publications with over 99% accuracy, relative to a manual classification. Our approach can be used easily with other homonyms and can greatly facilitate systematic reviews or similar work in which homonyms hinder the harnessing of large text corpora. Beyond homonyms we see great promise in combining automated content analysis and machine-learning methods to handle and screen big data for relevant information in conservation science.

Original languageEnglish
Pages (from-to)716-724
Number of pages9
JournalConservation Biology
Volume32
Issue number3
DOIs
StatePublished - 1 Jun 2018

Keywords

  • análisis automatizado de contenido
  • automated content analysis
  • big data
  • datos grandes
  • homographs
  • homógrafos
  • minería de textos
  • neural networks
  • redes neurales
  • reintroducciones
  • reintroductions
  • revisiones sistemáticas
  • systematic reviews
  • text mining

ASJC Scopus subject areas

  • Ecology, Evolution, Behavior and Systematics
  • Ecology
  • Nature and Landscape Conservation

Fingerprint

Dive into the research topics of 'Using machine learning to disentangle homonyms in large text corpora'. Together they form a unique fingerprint.

Cite this