TY - JOUR

T1 - Using rating scales for the assessment of physical self-concept

T2 - Why the number of response categories matters

AU - Freund, Philipp Alexander

AU - Tietjens, Maike

AU - Strauss, Bernd

PY - 2013/10/1

Y1 - 2013/10/1

N2 - The current study employs Mixture Distribution Rasch models to compare the psychometric properties of two rating scale variants (original rating scale with six response categories, N = 806 school students; a variant with four response categories, N = 905 school students) for five specific scales of the Physical Self-Description Questionnaire. In most cases, two-class solutions best fit the data, suggesting the presence of response sets. In particular, students with low educational levels appear to have problems using as many as six response categories correctly. The results suggest that for the Physical Self-Description Questionnaire, using a rating scale with six response categories can be problematic, because the test scores psychometric qualities may be substantially different across (latent) subgroups. Also discussed are implications for the use and development of assessment measures in general, highlighting the suitability of item response theory models for the investigation of test score properties and the need for heterogeneous samples.

AB - The current study employs Mixture Distribution Rasch models to compare the psychometric properties of two rating scale variants (original rating scale with six response categories, N = 806 school students; a variant with four response categories, N = 905 school students) for five specific scales of the Physical Self-Description Questionnaire. In most cases, two-class solutions best fit the data, suggesting the presence of response sets. In particular, students with low educational levels appear to have problems using as many as six response categories correctly. The results suggest that for the Physical Self-Description Questionnaire, using a rating scale with six response categories can be problematic, because the test scores psychometric qualities may be substantially different across (latent) subgroups. Also discussed are implications for the use and development of assessment measures in general, highlighting the suitability of item response theory models for the investigation of test score properties and the need for heterogeneous samples.

KW - Psychology

KW - Mixture Distribution Rasch model

KW - physical self-concept

KW - Physical Self-Description Questionnaire

KW - rating scales

KW - response categories

UR - http://www.scopus.com/inward/record.url?scp=84885968745&partnerID=8YFLogxK

U2 - 10.1080/1091367X.2013.807265

DO - 10.1080/1091367X.2013.807265

M3 - Journal articles

VL - 17

SP - 249

EP - 263

JO - Measurement in Physical Education and Exercise Science

JF - Measurement in Physical Education and Exercise Science

SN - 1091-367X

IS - 4

ER -