| Abstract: | Assessed the reliability of peer judgments about the ethical acceptability of research proposals by examining independent review of 111 submissions to a psychology department ethical review committee during a 10-mo period. With a 3-category rating protocol, independent reviewers agreed exactly on 67.7% of submissions. However, this level of observed agreement accounts for only 8% of the possible beyond-chance agreement. Lack of success in obtaining reliability is attributed to insufficient attention to reliability issues, and suggestions are discussed for improving interjudge agreement. (French abstract) (8 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved) |
