Are All Scales Created Equal?
Kaiser, R.B., & Kaplan, R.E. (2006, April). Are all scales created equal? Response format and the validity of managerial ratings. Paper in B.C. Hayes (Chair), The Four “Rs” of 360º Feedback: Second Generation Research on Determinants of Its Effectiveness, symposium presented at the 21st Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
Landy and Farr’s (1980) watershed review of performance ratings put a moratorium on rating format research. In effect, they concluded that all formats—BARS, Checklists, Graphic Scales, etc.—are about equally effective, or ineffective, at reducing errors and improving accuracy. Format research came to a halt while researchers turned to cognitive processes in ratings. But in recent years, perhaps a result of the ubiquity of 360-degree feedback, there has been a revived interest in rating formats (e.g., Borman et al., 2001). Interestingly, very few studies have directly compared the validity of ratings on different formats in predicting leadership criteria. That is the goal of the present study.
Filed under: Conference Presentations
→