Guardians of Science: Fairness and Reliability of Peer Review
Hans‐Dieter Daniel, William E. Russey · Medical Entomology and Zoology · 1994
Peer review as an instrument for the self-regulation of science. Peer review as a target for criticism: the reliability of manuscript reviews fairness in manuscript review - subjective judgmental tendencies and publication bias the validity of manuscript evaluation summary and assessment of criticism levelled at the peer-review process. The journal angewandte Chemie: the category Zuschriften (communications) the refereeing of communications evaluation form and comment sheet. Communications received during the year 1984. Initial internal evaluation, external review and editorial decisions. The reviewers for angewandte Chemie. The reviews. Reliability of manuscript refereeing: statistical measures for chance-corrected agreement reviewer agreement low levels of reviewer agreement - statistical artifact or a result of the process by which reviewers are selected? Fairness in manuscript evaluation: lenient and strict reviewers judgmental tendencies of reviewers and publication bias academic title of the corresponding author - reviewer judgments and editorial decisions subject matter - reviewer judgments and editorial decisions nationality of the corresponding author - reviewer judgments and editorial decisions. The validity of manuscript review: the fate of the rejected manuscripts comparison of mean criterion rates for accepted manuscripts and rejected manuscripts published elsewhere - the predictive validity of editorial decisions the predictive validity of initial judgments and reviewer recommendations. Suggestions for reform of the peer-review process.