Please support Web standards. Have a look at this page on the Web Standards Project site.
Craig, S.B. & Kaiser, R.B. (2003, April). Using Item Response Theory to assess measurement equivalence of 360* performance ratings across organizational levels. In A. Meade (Chair) Applications of Item Response Theory to Measurement in Organizations. Symposium presented at the annual conference of the Society for Industrial-Organizational Psychology in Orlando, FL.
Comparing 360 ratings from different individuals (raters) or for different individuals (ratings of target managers) assumes measurement equivalence--that the instrument measures the same things in the same way across populations. Prior research, atheoretical as it is, has examined the measurement equivalence of superior, peer, subordinate, and self ratings. We suggest that this is the wrong research question. On the basis of cognitive complexity theory, we argue that measurement inequivalence is most likely to be found between ratings from individuals at vastly different hierarchical levels--for instance, ratings from executives compared to supervisors. We demonstrate this using Item Response Theory to test for the presence of differential functioning of items and tests between populations.
Download slides:
IRT&360levels(Craig&Kaiser2003).pdf
Filed under: Conference Presentations