Model-Based Deep Learning

Nir Shlezinger, Jay Whang, Yonina C. Eldar, Alexandros G. Dimakis

Research output: Contribution to journalArticlepeer-review

28 Scopus citations

Abstract

Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information, and additional domain knowledge. Simple classical models are useful but sensitive to inaccuracies and may lead to poor performance when real systems display complex or dynamic behavior. On the other hand, purely data-driven approaches that are model-agnostic are becoming increasingly popular as datasets become abundant and the power of modern deep learning pipelines increases. Deep neural networks (DNNs) use generic architectures that learn to operate from data and demonstrate excellent performance, especially for supervised problems. However, DNNs typically require massive amounts of data and immense computational resources, limiting their applicability for some scenarios. In this article, we present the leading approaches for studying and designing model-based deep learning systems. These are methods that combine principled mathematical models with data-driven systems to benefit from the advantages of both approaches. Such model-based deep learning methods exploit both partial domain knowledge, via mathematical structures designed for specific problems, and learning from limited data. Among the applications detailed in our examples for model-based deep learning are compressed sensing, digital communications, and tracking in state-space models. Our aim is to facilitate the design and study of future systems at the intersection of signal processing and machine learning that incorporate the advantages of both domains.

Original languageEnglish
Pages (from-to)465-499
Number of pages35
JournalProceedings of the IEEE
Volume111
Issue number5
DOIs
StatePublished - 1 May 2023

Keywords

  • Deep learning
  • model-based machine learning
  • signal processing

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Science (all)

Fingerprint

Dive into the research topics of 'Model-Based Deep Learning'. Together they form a unique fingerprint.

Cite this