Non-invariance? An Overstated Problem With Misconceived Causes

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Scholars study representative international surveys to understand cross-cultural differences in mentality patterns, which are measured via complex multi-item constructs. Methodologists in this field insist with increasing vigor that detecting “non-invariance” in how a construct’s items associate with each other in different national samples is an infallible sign of encultured in-equivalences in how respondents understand the items. Questioning this claim, we demonstrate that a main source of non-invariance is the arithmetic of closed-ended scales in the presence of sample mean disparity. Since arithmetic principles are culture-unspecific, the non-invariance that these principles enforce in statistical terms is inconclusive of encultured in-equivalences in semantic terms. Because of this inconclusiveness, our evidence reveals furthermore that non-invariance is inconsequential for the cross-cultural functioning of multi-item constructs as concerns their nomological linkages to other variables of interest. We discuss the implications of these insights for measurement validation in cross-cultural settings with large sample mean disparity.

Original languageEnglish
JournalSociological Methods and Research
Volume52
Issue number3
Pages (from-to)1368-1400
Number of pages33
ISSN0049-1241
DOIs
Publication statusPublished - 08.2023

Bibliographical note

Funding Information:
Because the substance of our contribution is fundamentally critical of the methodological mainstream in the field of measurement equivalence, we are especially grateful to the editor of SMR and the anonymous reviewers for their instructive comments and for letting us pass to publication. We also thank the following colleagues for their invaluable comments on earlier versions of this paper and their encouragement: Plamen Akalyiski, Sjoerd Beugelsdijk, Klaus Boehnke, Michael H. Bond, Hermann Duelmer, Vera Lomazzi, Bert Meulemann, Michael (Misho) Minkov, Eduard (Ed) Ponarin, and Boris Sokolov. Any remaining shortcomings fall exclusively into our own responsibility. The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Significant parts of this study have been funded by the Russian Academic Excellence Project ‘5-100’.

Publisher Copyright:
© The Author(s) 2021.

    Research areas

  • compositional substitutability, emancipative values, item response, measurement equivalence, multigroup confirmatory factor analysis
  • Politics

DOI

Recently viewed

Publications

  1. Integration of laboratory experiments into introductory electrical engineering courses
  2. Training in Components of Problem-Solving Competence
  3. Failing and the perception of failure in student-driven transdisciplinary projects
  4. Digital Transformation and Institutional Work: A Paradox View
  5. Organizational practices for the aging workforce
  6. Do abundance distributions and species aggregation correctly predict macroecological biodiversity patterns in tropical forests?
  7. Effectiveness of an online recovery training for employees exposed to blurred boundaries between work and non-work
  8. Conceptualizing community in energy systems
  9. Enhancement of workability in AZ31 alloy - Processing maps
  10. Increased auditor independence by external rotation and separating audit and non audit duties?
  11. Differences in adjustment flexibility between regular and temporary agency work
  12. Passive Rotation of Rotational Joints and Its Computation Method
  13. Are all errors created equal?
  14. A blackboard architecture for workflows
  15. Collaborative benchmarking of functional-structural root architecture models
  16. Locus of control
  17. Integrating methods for ecosystem service assessment
  18. Integrating Common Ground and Informativeness in Pragmatic Word Learning
  19. Efficient co-regularised least squares regression
  20. Quantification and analysis of surface macroplastic contamination on arable areas
  21. Fermentative utilization of coffee mucilage using Bacillus coagulans and investigation of down-stream processing of fermentation broth for optically pure L(+)-lactic acid production
  22. Big Data - Characterizing an Emerging Research Field using Topic Models
  23. Analytics and Intuition in the Process of Selecting Talent
  24. Model-based nonlinear filter design for tower load reduction of wind power plants with active power control capability