Assessing interrater agreement on the job relevance of a test: A comparison of CVI, T, rWG(J)}, and r*WG(J)} indexes.

This article examines the problem of estimating interrater agreement about the job relevance of test items by examining 4 different indexes: C. H. Lawshe's (1975) Content Validity Index (CVI); H. E. A. Tinsley and D. J. Weiss's (1975) T; L. R. James, R. G. Demaree, and G. Wolf's (1984) r{wg(j)}; and M. K. Lindell, C. J. Brandt, and D. J. Whitney's (1999) r*{wg(j)}. These 4 indexes are shown to be systematically related to each other, but r*{wg(j)} is computationally simpler and is more generally applicable than the other indexes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)