Rethinking Measurement Equivalence in Comparative Political Research

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

A growing number of studies test key cultural constructs used in comparative political research for invariance across countries, only to declare these constructs incomparable if the invariance tests fail. The assumption underlying this kind of conclusion is that between-country differences in within-country factor solutions reflect cross-cultural inequivalence of the respective survey items. Using a Bayesian approach, we explore variation in measurement quality across countries focusing on sexual emancipation. We find that between-country differences in factor solutions reflect little more than imbalances in within-country dispersions of the construct items. As we demonstrate, discrete and bounded response scales used in standard surveys enforce a mathematical relationship between extreme country means, low within-country dispersions, and weak factor solutions. We formalize this insight by introducing a between–within model of cultural variation. Our contribution calls into question the practice of declaring constructs to be incomparable based on failed invariance tests.

Original languageEnglish
JournalPolitical Research Quarterly
Volume77
Issue number3
Pages (from-to)696-712
Number of pages17
ISSN1065-9129
DOIs
Publication statusPublished - 09.2024

Bibliographical note

Publisher Copyright:
© The Author(s) 2024.

    Research areas

  • Bayesian estimation, confirmatory factor analysis, cross-national comparisons, measurement equivalence, multilevel modeling, value orientations
  • Politics