Provable approximation properties for deep neural networks

Uri Shaham, Alexander Cloninger, Ronald R. Coifman

Research output: Contribution to journalArticlepeer-review

86 Scopus citations

Abstract

We discuss approximation of functions using deep neural nets. Given a function f on a d-dimensional manifold Γ⊂Rm, we construct a sparsely-connected depth-4 neural network and bound its error in approximating f. The size of the network depends on dimension and curvature of the manifold Γ the complexity of f, in terms of its wavelet description, and only weakly on the ambient dimension m. Essentially, our network computes wavelet functions, which are computed from Rectified Linear Units (ReLU).

Original languageEnglish
Pages (from-to)537-557
Number of pages21
JournalApplied and Computational Harmonic Analysis
Volume44
Issue number3
DOIs
StatePublished - 1 May 2018
Externally publishedYes

Keywords

  • Function approximation
  • Neural nets
  • Wavelets

ASJC Scopus subject areas

  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Provable approximation properties for deep neural networks'. Together they form a unique fingerprint.

Cite this