Abstract
We consider the problem of signal estimation (denoising) from a statistical-mechanical perspective, in continuation to a recent work on the analysis of mean-square error (MSE) estimation using a direct relationship between optimum estimation and certain partition functions. This paper consists of essentially two parts. In the first part, using the aforementioned relationship, we derive single-letter expressions of the asymptotic mismatched MSE of a codeword (from a randomly selected code), corrupted by a Gaussian vector channel. In the second part, we provide several examples to demonstrate phase transitions in the behavior of the MSE. These examples enable us to understand more deeply and to gather intuition regarding the roles of the real and the mismatched probability measures in creating these phase transitions.
Original language | English |
---|---|
Article number | 6717013 |
Pages (from-to) | 2190-2216 |
Number of pages | 27 |
Journal | IEEE Transactions on Information Theory |
Volume | 60 |
Issue number | 4 |
DOIs | |
State | Published - 1 Jan 2014 |
Externally published | Yes |
Keywords
- Minimum mean-square error (MMSE)
- conditional mean estimation
- mismatched MSE
- partition function
- phase transitions
- statistical mechanics
- threshold effect
ASJC Scopus subject areas
- Information Systems
- Computer Science Applications
- Library and Information Sciences