TY - JOUR
T1 - Cramér-Rao bound for constrained parameter estimation using Lehmann-unbiasedness
AU - Nitzan, Eyal
AU - Routtenberg, Tirza
AU - Tabrikian, Joseph
N1 - Funding Information:
Manuscript received January 13, 2018; revised May 28, 2018 and September 17, 2018; accepted November 7, 2018. Date of publication November 30, 2018; date of current version December 24, 2018. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Remy Boyer. This work was partially supported by The Israel Science Foundation under Grants 1160/15 and 1173/16. (Corresponding author: Eyal Nitzan.) The authors are with the Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva 84105, Israel (e-mail:, eyalni@ee.bgu.ac.il; tirzar@bgu.ac.il; joseph@bgu.ac.il).
Publisher Copyright:
© 1991-2012 IEEE.
PY - 2019/2/1
Y1 - 2019/2/1
N2 - The constrained Cramér-Rao bound (CCRB) is a lower bound on the mean-squared-error (MSE) of estimators that satisfy some unbiasedness conditions. Although the CCRB unbiasedness conditions are satisfied asymptotically by the constrained maximum likelihood (CML) estimator, in the non-asymptotic region these conditions are usually too strict and the commonly used estimators, such as the CML estimator, do not satisfy them. Therefore, the CCRB may not be a lower bound on the MSE matrix of such estimators. In this paper, we propose a new definition for unbiasedness under constraints, denoted by C-unbiasedness, which is based on using Lehmann-unbiasedness with a weighted MSE (WMSE) risk and taking into account the parametric constraints. In addition to C-unbiasedness, a Cramér-Rao-type bound on the WMSE of C-unbiased estimators, denoted as Lehmann-unbiased CCRB (LU-CCRB), is derived. This bound is a scalar bound that depends on the chosen weighted combination of estimation errors. It is shown that C-unbiasedness is less restrictive than the CCRB unbiasedness conditions. Thus, the set of estimators that satisfy the CCRB unbiasedness conditions is a subset of the set of C-unbiased estimators and the proposed LU-CCRB may be an informative lower bound in cases where the corresponding CCRB is not. In the simulations, we examine linear and nonlinear estimation problems under nonlinear constraints in which the CML estimator is shown to be C-unbiased and the LU-CCRB is an informative lower bound on the WMSE, while the corresponding CCRB on the WMSE is not a lower bound and is not informative in the non-asymptotic region.
AB - The constrained Cramér-Rao bound (CCRB) is a lower bound on the mean-squared-error (MSE) of estimators that satisfy some unbiasedness conditions. Although the CCRB unbiasedness conditions are satisfied asymptotically by the constrained maximum likelihood (CML) estimator, in the non-asymptotic region these conditions are usually too strict and the commonly used estimators, such as the CML estimator, do not satisfy them. Therefore, the CCRB may not be a lower bound on the MSE matrix of such estimators. In this paper, we propose a new definition for unbiasedness under constraints, denoted by C-unbiasedness, which is based on using Lehmann-unbiasedness with a weighted MSE (WMSE) risk and taking into account the parametric constraints. In addition to C-unbiasedness, a Cramér-Rao-type bound on the WMSE of C-unbiased estimators, denoted as Lehmann-unbiased CCRB (LU-CCRB), is derived. This bound is a scalar bound that depends on the chosen weighted combination of estimation errors. It is shown that C-unbiasedness is less restrictive than the CCRB unbiasedness conditions. Thus, the set of estimators that satisfy the CCRB unbiasedness conditions is a subset of the set of C-unbiased estimators and the proposed LU-CCRB may be an informative lower bound in cases where the corresponding CCRB is not. In the simulations, we examine linear and nonlinear estimation problems under nonlinear constraints in which the CML estimator is shown to be C-unbiased and the LU-CCRB is an informative lower bound on the WMSE, while the corresponding CCRB on the WMSE is not a lower bound and is not informative in the non-asymptotic region.
KW - Constrained Cramér-Rao bound (CCRB)
KW - Lehmann-unbiasedness
KW - Non-Bayesian parameter estimation
KW - Parametric constraints
KW - Weighted mean-squared-error (WMSE)
UR - http://www.scopus.com/inward/record.url?scp=85057858812&partnerID=8YFLogxK
U2 - 10.1109/TSP.2018.2883915
DO - 10.1109/TSP.2018.2883915
M3 - Article
AN - SCOPUS:85057858812
SN - 1053-587X
VL - 67
SP - 753
EP - 768
JO - IEEE Transactions on Signal Processing
JF - IEEE Transactions on Signal Processing
IS - 3
M1 - 8554108
ER -