Skip to main navigation Skip to search Skip to main content

Is My Data in Your Retrieval Database? Membership Inference Attacks Against Retrieval Augmented Generation

  • Maya Anderson
  • , Guy Amit
  • , Abigail Goldsteen

Research output: Contribution to journal › Conference article › peer-review

12 Scopus citations

Abstract

Retrieval Augmented Generation (RAG) systems have shown great promise in natural language processing. However, their reliance on data stored in a retrieval database, which may contain proprietary or sensitive information, introduces new privacy concerns. Specifically, an attacker may be able to infer whether a certain text passage appears in the retrieval database by observing the outputs of the RAG system, an attack known as a Membership Inference Attack (MIA). Despite the significance of this threat, MIAs against RAG systems have yet remained under-explored. This study addresses this gap by introducing an efficient and easy-to-use method for conducting MIA against RAG systems. We demonstrate the effectiveness of our attack using two benchmark datasets and multiple generative models, showing that the membership of a document in the retrieval database can be efficiently determined through the creation of an appropriate prompt in both black-box and gray-box settings. Moreover, we introduce an initial defense strategy based on adding instructions to the RAG template, which shows high effectiveness for some datasets and models. Our findings highlight the importance of implementing security countermeasures in deployed RAG systems and developing more advanced defenses to protect the privacy and security of retrieval databases.

Original languageEnglish
Pages (from-to)474-485
Number of pages12
JournalInternational Conference on Information Systems Security and Privacy
Volume2
DOIs
StatePublished - 1 Jan 2025
Externally publishedYes
Event11th International Conference on Information Systems Security and Privacy, ICISSP 2025 - Porto, Portugal
Duration: 20 Feb 2025 → 22 Feb 2025

Keywords

  • AI Privacy
  • Large Language Models
  • Membership Inference
  • RAG

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Information Systems

Fingerprint

Dive into the research topics of 'Is My Data in Your Retrieval Database? Membership Inference Attacks Against Retrieval Augmented Generation'. Together they form a unique fingerprint.

Cite this