Which type of reliability assesses consistency between two scorers?

• A. Inter-Rater
• B. Test-Retest
• C. Form Reliability
• D. Inter-item

Answer: (A)

This item is about how we judge reliability when more than one person scores the same performance. Inter-rater reliability measures the degree to which different scorers apply the scoring criteria in the same way and produce similar ratings. High agreement between raters gives confidence that the scores reflect the construct being measured rather than individual biases. In practice, this can be quantified with statistics like Cohen’s kappa for categorical judgments or an intraclass correlation for numeric scores.

By comparison, test-retest reliability looks at consistency of scores over time on the same test, assuming the trait is stable. Form reliability (parallel-forms reliability) checks whether different versions of the test yield comparable results. Inter-item reliability examines whether the items within a single form consistently measure the same construct (internal consistency).