Journal of Data and Information Science ›› 2017, Vol. 2 ›› Issue (4): 65-80.doi: 10.1515/jdis-2017-0020

• Research Paper • Previous Articles     Next Articles

An Accurate and Impartial Expert Assignment Method for Scientific Project Review

Mingliang Yue1,Kailin Tian2,Tingcan Ma1()   

  1. 1.Wuhan Documentation and Information Center, Chinese Academy of Sciences, Wuhan 430071, China
    2.Library, South West Forestry University, Kunming 650224, China
  • Received:2017-06-23 Revised:2017-10-31 Online:2017-12-05 Published:2017-12-06

Abstract:

Purpose: This paper proposes an expert assignment method for scientific project review that considers both accuracy and impartiality. As impartial and accurate peer review is extremely important to ensure the quality and feasibility of scientific projects, enhanced methods for managing the process are needed.Design/methodology/approach: To ensure both accuracy and impartiality, we design four criteria, the reviewers’ fitness degree, research intensity, academic association, and potential conflict of interest, to express the characteristics of an appropriate peer review expert. We first formalize the expert assignment problem as an optimization problem based on the designed criteria, and then propose a randomized algorithm to solve the expert assignment problem of identifying reviewer adequacy.Findings: Simulation results show that the proposed method is quite accurate and impartial during expert assignment.Research limitations: Although the criteria used in this paper can properly show the characteristics of a good and appropriate peer review expert, more criteria/conditions can be included in the proposed scheme to further enhance accuracy and impartiality of the expert assignment.Practical implications: The proposed method can help project funding agencies (e.g. the National Natural Science Foundation of China) find better experts for project peer review.Originality/value: To the authors’ knowledge, this is the first publication that proposes an algorithm that applies an impartial approach to the project review expert assignment process. The simulation results show the effectiveness of the proposed method.

Key words: Expert assignment, Accuracy, Impartiality, Randomized algorithm