Applying item response theory

Craig, S.B. & Kaiser, R.B. (2003). Applying item response theory to multisource performance ratings: What are the consequences of violating the independent observations assumption? Organizational Research Methods, 6, 41-58.

Item Response Theory (IRT) is a sophisticated data analytic tool well-suited to a number of problems in 360-degree feedback. But because 360 ratings involve several raters of the same focal manager, the statistical assumption of independent observations is not met. This study determined that the real-world impact of violating this assumption is trivial. The results suggest that researchers can safely apply IRT to such questions as measurement equivalence of language translations, the analysis of time 1 – time 2 change, and so forth.

Article in copyrighted peer-review journal: Organizational Research Methods

Filed under: Journal & Magazine Articles

→