Reviewing peer review: a quantitative analysis of peer review

Casati, Fabio and Marchese, Maurizio and Mirylenka, Katsiaryna and Ragone, Azzurra (2010) Reviewing peer review: a quantitative analysis of peer review. UNSPECIFIED. (Unpublished)

Download (867Kb) | Preview


    In this paper we focus on the analysis of peer reviews and reviewers behavior in a number of different review processes. More specifically, we report on the development, definition and rationale of a theoretical model for peer review processes to support the identification of appropriate metrics to assess the processes main properties. We then apply the proposed model and analysis framework to data sets from conference evaluation processes and we discuss the results implications and their eventual use toward improving the analyzed peer review processes. A number of unexpected results were found, in particular: (1) the low correlation between peer review outcome and impact in time of the accepted contributions and (2) the presence of an high level of randomness in the analyzed peer review processes.

    Item Type: Departmental Technical Report
    Department or Research center: Information Engineering and Computer Science
    Subjects: Q Science > QA Mathematics > QA076 Computer software
    Report Number: DISI-10-014
    Repository staff approval on: 27 Apr 2010

    Actions (login required)

    View Item