TY - GEN
T1 - An extended query performance prediction framework utilizing passage-level information
AU - Roitman, Haggai
N1 - Publisher Copyright:
© 2018 Association for Computing Machinery.
PY - 2018/9/10
Y1 - 2018/9/10
N2 - We show that document-level post-retrieval query performance prediction (QPP) methods are mostly suited for short query prediction tasks; such methods perform significantly worse in verbose (long and informative) query prediction settings. To address the prediction quality gap among query lengths, we propose a novel passage-level post-retrieval QPP framework. Our empirical analysis demonstrates that, those QPP methods that utilize passage-level information are much better suited for verbose QPP settings. Moreover, our proposed predictors, which utilize both document-level and passage-level information provide a more robust prediction which is less sensitive to query length.
AB - We show that document-level post-retrieval query performance prediction (QPP) methods are mostly suited for short query prediction tasks; such methods perform significantly worse in verbose (long and informative) query prediction settings. To address the prediction quality gap among query lengths, we propose a novel passage-level post-retrieval QPP framework. Our empirical analysis demonstrates that, those QPP methods that utilize passage-level information are much better suited for verbose QPP settings. Moreover, our proposed predictors, which utilize both document-level and passage-level information provide a more robust prediction which is less sensitive to query length.
UR - https://www.scopus.com/pages/publications/85063538127
U2 - 10.1145/3234944.3234946
DO - 10.1145/3234944.3234946
M3 - Conference contribution
AN - SCOPUS:85063538127
T3 - ICTIR 2018 - Proceedings of the 2018 ACM SIGIR International Conference on the Theory of Information Retrieval
SP - 35
EP - 42
BT - ICTIR 2018 - Proceedings of the 2018 ACM SIGIR International Conference on the Theory of Information Retrieval
PB - Association for Computing Machinery, Inc
T2 - 8th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2018
Y2 - 14 September 2018 through 17 September 2018
ER -