Projection pursuit mixture density estimation

Research output: Contribution to journalArticlepeer-review

23 Scopus citations

Abstract

In this paper we seek a Gaussian mixture model (GMM) of an n-variate probability density function. Usually the parameters of GMMs are determined in the original n-dimensional space by optimizing a maximum likelihood (ML) criterion. A practical deficiency of this method of fitting GMMs is its poor performance when dealing with high-dimensional data since a large sample size is needed to match the accuracy that is possible in low dimensions. We propose a method for fitting the GMM based on the projection pursuit strategy. This GMM is highly constrained and hence its ability to model structure in subspaces is enhanced, compared to a direct ML fitting of a GMM in high dimensions. Our method is closely related to recently developed independent factor analysis (IFA) mixture models. The comparisons with ML fitting of GMM in n-dimensions and IFA mixtures show that the proposed method is an attractive choice for fitting GMMs using small sizes of training sets.

Original languageEnglish
Pages (from-to)4376-4383
Number of pages8
JournalIEEE Transactions on Signal Processing
Volume53
Issue number11
DOIs
StatePublished - 1 Nov 2005

Keywords

  • Blind source separation
  • Gaussian mixture models
  • Independent component analysis
  • Independent factor analysis
  • Latent variable models
  • Multivariate density estimation
  • Probabilistic principal component analysis
  • Projection pursuit
  • Radial basis functions
  • Small sample size

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Projection pursuit mixture density estimation'. Together they form a unique fingerprint.

Cite this