Output details

Three empirical studies on the agreement of reviewers about the quality of software engineering experiments

<33>Evidence-based practice requires practitioners to reflect on and attempt to improve their processes. Our experience of evidence-based software engineering identified problems assessing the quality of empirical studies. Outcomes of these studies suggest that researchers should use checklists, aggregate checklist outcomes, use three independent assessors and adopt the median assessment. They provided empirical justification for the methodology used in our study of software engineering (SE ) experiment quality (Brereton paper 3). Also, more reliable assessment of the quality of SE experiments should result in more reliable outcomes from systematic reviews and hence in more reliable recommendations for SE best practice.