Output details
11 - Computer Science and Informatics
University of Southampton
An experiment in comparing human-computation techniques
Significance of output:
<16>This article presents an empirical feasibility study of two important human-computation techniques, microtask crowdsourcing and games-with-a-purpose (GWAPs). Based on usage data collected from our OntoPronto GWAP, we set up an equivalent experiment on a popular microtask platform, and analyzed the development costs and accuracy of the results of the two approaches. It is the first data-driven study of this kind in the human computation literature, and led to several research bids, and invited talks and tutorials. The accuracy of the human contributions (around 90% in both cases) was evaluated manually in terms of correctness and inter-participant agreement.