Non-invariance? An Overstated Problem With Misconceived Causes

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Scholars study representative international surveys to understand cross-cultural differences in mentality patterns, which are measured via complex multi-item constructs. Methodologists in this field insist with increasing vigor that detecting “non-invariance” in how a construct’s items associate with each other in different national samples is an infallible sign of encultured in-equivalences in how respondents understand the items. Questioning this claim, we demonstrate that a main source of non-invariance is the arithmetic of closed-ended scales in the presence of sample mean disparity. Since arithmetic principles are culture-unspecific, the non-invariance that these principles enforce in statistical terms is inconclusive of encultured in-equivalences in semantic terms. Because of this inconclusiveness, our evidence reveals furthermore that non-invariance is inconsequential for the cross-cultural functioning of multi-item constructs as concerns their nomological linkages to other variables of interest. We discuss the implications of these insights for measurement validation in cross-cultural settings with large sample mean disparity.

Original languageEnglish
JournalSociological Methods and Research
Volume52
Issue number3
Pages (from-to)1368-1400
Number of pages33
ISSN0049-1241
DOIs
Publication statusPublished - 08.2023

Bibliographical note

Funding Information:
Because the substance of our contribution is fundamentally critical of the methodological mainstream in the field of measurement equivalence, we are especially grateful to the editor of SMR and the anonymous reviewers for their instructive comments and for letting us pass to publication. We also thank the following colleagues for their invaluable comments on earlier versions of this paper and their encouragement: Plamen Akalyiski, Sjoerd Beugelsdijk, Klaus Boehnke, Michael H. Bond, Hermann Duelmer, Vera Lomazzi, Bert Meulemann, Michael (Misho) Minkov, Eduard (Ed) Ponarin, and Boris Sokolov. Any remaining shortcomings fall exclusively into our own responsibility. The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Significant parts of this study have been funded by the Russian Academic Excellence Project ‘5-100’.

Publisher Copyright:
© The Author(s) 2021.

    Research areas

  • compositional substitutability, emancipative values, item response, measurement equivalence, multigroup confirmatory factor analysis
  • Politics

DOI

Recently viewed

Researchers

  1. Isabel Mehl

Publications

  1. Operationalizing ecosystem services for the mitigation of soil threats
  2. A framework to enable sustainability-oriented transition activities in HEIs
  3. Personalized Transaction Kernels for Recommendation Using MCTS
  4. Polycrisis patterns
  5. Script and sound
  6. Dynamic capabilities and routinization
  7. Possible underestimations of risks for the environment due to unregulated emissions of biocides from households to wastewater
  8. Explaining Investment Dynamics: Empirical Evidence from German New Ventures
  9. Assessment of occupational exertion and strain in laboratory- and real occupational environments
  10. Extending Enterprise Architectures for Adopting the Internet of Things
  11. Wie lang sollte eine Rollstuhlrampe sein?
  12. Assessing mire-specific biodiversity with an indicator based approach
  13. Vorstellungen über null und Null
  14. Tristan Garcia, Form and Object
  15. Existential insecurity and deference to authority
  16. Systematic learning in water governance: insights from five local adaptive management projects for water quality innovation
  17. Research-Creation
  18. An assessment of the published results of animal relocations
  19. Towards a dimensional approach to common mental disorders in the ICD-11?
  20. Linking trait similarity to interspecific spatial associations in a moist tropical forest
  21. On the Existence of Digital Objects
  22. Case Study
  23. Effects of budget constraints on conservation network design for biodiversity and ecosystem services
  24. Beyond Urban Challenges-Virtual Reality Tools in Participatory Design Processes
  25. Results from the project 'Acceptance of CO2 capture and storage
  26. Conditionality of EU funds: an instrument to enforce EU fundamental values?
  27. Erich und die Übersetzer
  28. Survey on English Entity Linking on Wikidata
  29. Vorräte - Schätzung des Fertigstellungsgrades bei der Percentage of Completion Methode
  30. Effectiveness of the holistic primary school-based intervention MindMatters
  31. Teamplay, Clanhopping und Wallhacker
  32. Dem Editor-in-Chief der ZfB, Günter Fandel, zum Fünfundsechzigsten