Robust standard deviation estimation for query performance prediction

Abstract

We derive a robust standard deviation estimator for post-retrieval query performance prediction. To this end, we propose a novel bootstrap sampling approach which is inspired by user search behavior. Using an evaluation with several TREC benchmarks and a comparison with several different types of baselines, we demonstrate that, overall, our estimator results in an enhanced query performance prediction.