Multi-target shrinkage estimation for covariance matrices

Tomer Lancewicki, Mayer Aladjem

Research output: Contribution to journalArticlepeer-review

26 Scopus citations

Abstract

Covariance matrix estimation is problematic when the number of samples is relatively small compared with the number of variables. One way to tackle this problem is through the use of shrinkage estimators that offer a compromise between the sample covariance matrix and a well-conditioned matrix (also known as the "target") with the aim of minimizing the mean-squared error (MSE). The use of only one target limits the shrinkage estimators' flexibility when minimizing the MSE. In this paper, we propose a multi-target shrinkage estimator (MTSE) for covariance matrices that exploits the Lediot-Wolf (LW) method by utilizing several targets simultaneously. This greatly increases the estimator's flexibility and enables it to attain a lower MSE. We also offer a general target that serves as a framework for designing a wide variety of targets. In consequence, instead of studying individual targets, the general framework can be utilized. We then show that the framework encompasses several targets that already exist in the literature. Numerical simulations demonstrate that the MTSE significantly reduces the MSE and is highly effective in classification tasks.

Original languageEnglish
Article number6935094
Pages (from-to)6380-6390
Number of pages11
JournalIEEE Transactions on Signal Processing
Volume62
Issue number24
DOIs
StatePublished - 1 Dec 2014

Keywords

  • Covariance estimation
  • minimum mean-squared error
  • shrinkage estimator

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Multi-target shrinkage estimation for covariance matrices'. Together they form a unique fingerprint.

Cite this