TY - GEN
T1 - Optimal biased estimation using Lehmann-unbiasedness
AU - Nitzan, Eyal
AU - Routtenberg, Tirza
AU - Tabrikian, Joseph
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2017/6/16
Y1 - 2017/6/16
N2 - This paper deals with non-Bayesian parameter estimation under the mean-squared-error (MSE), which is a topic of great interest in various engineering fields. Although the unbiasedness condition is commonly used in non-Bayesian MSE estimation, in many cases biased estimation may result in better performance. However, no method for determining the optimal bias function in general cases is available. We propose a new approach for uniform minimum MSE biased estimation, where the optimal bias is chosen in accordance with Lehmann-unbiasedness definition. The proposed approach is based on modifying the MSE risk by its multiplication with a weighting function of the unknown parameter, g2. Under this modified risk, Lehmann's definition of unbiasedness provides a condition referred to as g-unbiasedness. By using the g-unbiasedness, we derive a novel Cramér-Rao-type lower bound on the MSE of locally g-unbiased estimators. In addition, we show that if there exists an estimator that achieves the new bound, then it is produced by the penalized maximum likelihood estimator with a penalty function log g. Simulations show that the proposed approach can lead to non-trivial estimators with lower MSE than existing mean-unbiased estimators.
AB - This paper deals with non-Bayesian parameter estimation under the mean-squared-error (MSE), which is a topic of great interest in various engineering fields. Although the unbiasedness condition is commonly used in non-Bayesian MSE estimation, in many cases biased estimation may result in better performance. However, no method for determining the optimal bias function in general cases is available. We propose a new approach for uniform minimum MSE biased estimation, where the optimal bias is chosen in accordance with Lehmann-unbiasedness definition. The proposed approach is based on modifying the MSE risk by its multiplication with a weighting function of the unknown parameter, g2. Under this modified risk, Lehmann's definition of unbiasedness provides a condition referred to as g-unbiasedness. By using the g-unbiasedness, we derive a novel Cramér-Rao-type lower bound on the MSE of locally g-unbiased estimators. In addition, we show that if there exists an estimator that achieves the new bound, then it is produced by the penalized maximum likelihood estimator with a penalty function log g. Simulations show that the proposed approach can lead to non-trivial estimators with lower MSE than existing mean-unbiased estimators.
KW - Cramér-Rao bound
KW - Lehmann-unbiasedness
KW - Non-Bayesian parameter estimation
KW - mean-squared- error (MSE)
KW - penalized maximum likelihood
UR - http://www.scopus.com/inward/record.url?scp=85023759158&partnerID=8YFLogxK
U2 - 10.1109/ICASSP.2017.7953007
DO - 10.1109/ICASSP.2017.7953007
M3 - Conference contribution
AN - SCOPUS:85023759158
T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
SP - 4496
EP - 4500
BT - 2017 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2017 - Proceedings
PB - Institute of Electrical and Electronics Engineers
T2 - 2017 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2017
Y2 - 5 March 2017 through 9 March 2017
ER -