An application of psychological scaling methods to content analysis: The use of empirically derived criterion weights to improve intercoder reliability.

A method is described in which a psychological scaling technique is applied to the analysis of the contents of written messages in order to provide a more precise metric for such measurement. The attribute to be measured was the extent to which each message communicated an attempt on the part of the writer to control the group's decision or procedures. 2 scales were developed, a logical scale comprised of 9 categories, and an empirical scale based on the application of Thurstone's successive interval technique to a set of written messages. The empirical scale was found to have a higher reliability than the logical scale with untrained coders. Possible reasons for the superiority of the empirical scale were discussed, and suggestions made concerning its use in future research. (16 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)