Non-Bayesian Post-Model-Selection Estimation as Estimation under Model Misspecification

Nadav Harel, Tirza Routtenberg

Research output: Contribution to journalArticlepeer-review

Abstract

In many parameter estimation problems, the exact model is unknown. In such cases, a predetermined data-based selection rule selects a parametric model from a set of candidates before the parameter estimation. The existing framework for estimation under model misspecification does not account for the selection process that led to the misspecified model. Moreover, in post-model-selection estimation, there are multiple candidate models chosen based on the observations, making the interpretation of the assumed model in the misspecified setting non-trivial. In this work, we present three interpretations to address the problem of non-Bayesian post-model-selection estimation as an estimation under model misspecification problem: the naive interpretation, the normalized interpretation, and the selective inference interpretation, and discuss their properties. For each of these interpretations, we developed the corresponding misspecified maximum likelihood (MML) estimator and the misspecified Cramér-Rao-type lower bound. The relations between the estimators and the performance bounds, as well as their properties, are discussed. Finally, we demonstrate the performance of the proposed estimators and bounds via simulations of estimation after channel selection. We show that the proposed performance bounds are more informative than the oracle Cramér-Rao Bound (CRB), where the third interpretation (selective inference) results in the lowest mean-squared-error (MSE) among the estimators.

Original languageEnglish
Pages (from-to)3641-3657
Number of pages17
JournalIEEE Transactions on Signal Processing
Volume72
DOIs
StatePublished - 1 Jan 2024

Keywords

  • Estimation under model misspecification
  • misspecified Cramér-Rao bound
  • model selection
  • post-model-selection estimation
  • selective inference

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Non-Bayesian Post-Model-Selection Estimation as Estimation under Model Misspecification'. Together they form a unique fingerprint.

Cite this