TY - GEN
T1 - Theoretical categorization of query performance predictors
AU - Makarenkov, Victor
AU - Shapira, Bracha
AU - Rokach, Lior
N1 - Publisher Copyright:
© 2015 ACM.
PY - 2015/9/27
Y1 - 2015/9/27
N2 - The query-performance prediction task aims at estimating the retrieval effectiveness of queries without obtaining relevance feedback from users. Most of the recently proposed predictors were empirically evaluated with various datasets to demonstrate their merits. We propose a framework for theoretical categorization and estimation of the value of query performance predictors (QPP) without empirical evaluation. We demonstrate the application of the proposed framework on four representative selected predictors and show how it emphasizes their strengths and weaknesses. The main contribution of this work is the theoretical grounded categorization of representative QPP.
AB - The query-performance prediction task aims at estimating the retrieval effectiveness of queries without obtaining relevance feedback from users. Most of the recently proposed predictors were empirically evaluated with various datasets to demonstrate their merits. We propose a framework for theoretical categorization and estimation of the value of query performance predictors (QPP) without empirical evaluation. We demonstrate the application of the proposed framework on four representative selected predictors and show how it emphasizes their strengths and weaknesses. The main contribution of this work is the theoretical grounded categorization of representative QPP.
KW - Categorization
KW - Query-performance prediction
KW - Theoretical evaluation
UR - http://www.scopus.com/inward/record.url?scp=84964335247&partnerID=8YFLogxK
U2 - 10.1145/2808194.2809475
DO - 10.1145/2808194.2809475
M3 - Conference contribution
AN - SCOPUS:84964335247
T3 - ICTIR 2015 - Proceedings of the 2015 ACM SIGIR International Conference on the Theory of Information Retrieval
SP - 369
EP - 372
BT - ICTIR 2015 - Proceedings of the 2015 ACM SIGIR International Conference on the Theory of Information Retrieval
PB - Association for Computing Machinery, Inc
T2 - 5th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2015
Y2 - 27 September 2015 through 30 September 2015
ER -