Output details
11 - Computer Science and Informatics
University College London
Return to search
Output 0 of 0 in the submission
Output title
A simple and efficient sampling method for estimating AP and NDCG.
Type
E - Conference contribution
Name of conference/published proceedings
SIGIR
Volume number
-
Issue number
-
First page of article
603
ISSN of proceedings
-
Year of publication
2008
Number of additional authors
2
Additional information
<17> Originality: First paper to reduce the judgement effort needed to compute evaluation metrics in information retrieval by 95%, which enabled the construction of many large scale benchmark collections. Significance: Constructing test collections in IR requires a significant amount of human relevance judgements, costing around millions of dollars for commercial companies and government organizations. This work enabled reducing this cost by 95%. Rigour: A theoretical approach to the problem based on stratified sampling, validated via extensive experiments.
Interdisciplinary
-
Cross-referral requested
-
Research group
None
Citation count
26
Proposed double-weighted
No
Double-weighted statement
-
Reserve for a double-weighted output
No
Non-English
No
English abstract
-
