Non-invariance? An Overstated Problem With Misconceived Causes

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Scholars study representative international surveys to understand cross-cultural differences in mentality patterns, which are measured via complex multi-item constructs. Methodologists in this field insist with increasing vigor that detecting “non-invariance” in how a construct’s items associate with each other in different national samples is an infallible sign of encultured in-equivalences in how respondents understand the items. Questioning this claim, we demonstrate that a main source of non-invariance is the arithmetic of closed-ended scales in the presence of sample mean disparity. Since arithmetic principles are culture-unspecific, the non-invariance that these principles enforce in statistical terms is inconclusive of encultured in-equivalences in semantic terms. Because of this inconclusiveness, our evidence reveals furthermore that non-invariance is inconsequential for the cross-cultural functioning of multi-item constructs as concerns their nomological linkages to other variables of interest. We discuss the implications of these insights for measurement validation in cross-cultural settings with large sample mean disparity.

Original languageEnglish
JournalSociological Methods and Research
Volume52
Issue number3
Pages (from-to)1368-1400
Number of pages33
ISSN0049-1241
DOIs
Publication statusPublished - 08.2023

Bibliographical note

Funding Information:
Because the substance of our contribution is fundamentally critical of the methodological mainstream in the field of measurement equivalence, we are especially grateful to the editor of SMR and the anonymous reviewers for their instructive comments and for letting us pass to publication. We also thank the following colleagues for their invaluable comments on earlier versions of this paper and their encouragement: Plamen Akalyiski, Sjoerd Beugelsdijk, Klaus Boehnke, Michael H. Bond, Hermann Duelmer, Vera Lomazzi, Bert Meulemann, Michael (Misho) Minkov, Eduard (Ed) Ponarin, and Boris Sokolov. Any remaining shortcomings fall exclusively into our own responsibility. The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Significant parts of this study have been funded by the Russian Academic Excellence Project ‘5-100’.

Publisher Copyright:
© The Author(s) 2021.

    Research areas

  • compositional substitutability, emancipative values, item response, measurement equivalence, multigroup confirmatory factor analysis
  • Politics

DOI

Recently viewed

Publications

  1. Performance of methods to select landscape metrics for modelling species richness
  2. Integrating Common Ground and Informativeness in Pragmatic Word Learning
  3. Exchanging Knowledge and Good Practices of Education for Sustainable Development within a Global Student Organization (oikos)
  4. Searching for New Languages, Searching for Minor Voices in the Archive
  5. Using photography to elicit grazier values and management practices relating to tree survival and recruitment
  6. Buckling Analysis under Uncertainty
  7. Self-Regulated Learning with Expository Texts as a Competence
  8. Developing a Process for the Analysis of User Journeys and the Prediction of Dropout in Digital Health Interventions:
  9. Article 11 Formal Validity
  10. Microstructural and mechanical aspects of reinforcement welds for lightweight components produced by friction hydro pillar processing
  11. Communicating CCS
  12. Second-Order Sliding Mode Control with State and Disturbance Estimation for a Permanent Magnet Linear Motor
  13. Towards Computer Simulations of Virtue Ethics
  14. A cascade regulator using Lyapunov's PID-PID controllers for an aggregate actuator in automotive applications
  15. Effectiveness of self-generation during learning is dependent on individual differences in need for cognition
  16. Accuracy Improvement of Vision System for Mobile Robot Navigation by Finding the Energetic Center of Laser Signal
  17. Mechanical properties and microstructures of nano SiC reinforced ZE10 composites prepared with ultrasonic vibration
  18. Playing in the Spaces: Anarchism in the Classroom
  19. Combining SMC and MTPA Using an EKF to estimate parameters and states of an interior PMSM
  20. Comparison of Backpropagation and Kalman Filter-based Training for Neural Networks
  21. Linked Accomplishment Of Order Management And Production Planning And Control. An Integrated Model-based Approach
  22. Modellieren in der Sekundarstufe
  23. Evidence for singlet state β cleavage in the photoreaction of α-(2,6-dimethoxyphenoxy)-acetophenone inferred from time-resolved CIDNP spectroscopy
  24. Methods in Writing Process Research
  25. Chip extrusion with integrated equal channel angular pressing
  26. Development of Early Spatial Perspective-Taking - Toward a Three-Level Model