TY - GEN
T1 - A study of query performance prediction for answer quality determination
AU - Roitman, Haggai
AU - Erera, Shai
AU - Feigenblat, Guy
N1 - Publisher Copyright:
© 2019 Association for Computing Machinery.
PY - 2019/9/23
Y1 - 2019/9/23
N2 - We study a constrained retrieval setting in which either a single qualitative answer is provided as a response to a user-query or none. Given a user-query and the "best" answer that was retrieved from the underlying search engine, we wish to determine whether or not to accept it. To address this challenge, we propose an answer quality determination approach which leverages a novel set of answer-level query performance prediction (QPP) features, derived from a couple of recent discriminative QPP frameworks. Using various search benchmarks with both ad-hoc retrieval and nonfactoid question answering (QA) tasks, we demonstrate the effectiveness of our approach.
AB - We study a constrained retrieval setting in which either a single qualitative answer is provided as a response to a user-query or none. Given a user-query and the "best" answer that was retrieved from the underlying search engine, we wish to determine whether or not to accept it. To address this challenge, we propose an answer quality determination approach which leverages a novel set of answer-level query performance prediction (QPP) features, derived from a couple of recent discriminative QPP frameworks. Using various search benchmarks with both ad-hoc retrieval and nonfactoid question answering (QA) tasks, we demonstrate the effectiveness of our approach.
UR - https://www.scopus.com/pages/publications/85074230246
U2 - 10.1145/3341981.3344219
DO - 10.1145/3341981.3344219
M3 - Conference contribution
AN - SCOPUS:85074230246
T3 - ICTIR 2019 - Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval
SP - 43
EP - 46
BT - ICTIR 2019 - Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval
PB - Association for Computing Machinery, Inc
T2 - 9th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2019
Y2 - 2 October 2019 through 5 October 2019
ER -