Non-invariance? An Overstated Problem With Misconceived Causes

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Scholars study representative international surveys to understand cross-cultural differences in mentality patterns, which are measured via complex multi-item constructs. Methodologists in this field insist with increasing vigor that detecting “non-invariance” in how a construct’s items associate with each other in different national samples is an infallible sign of encultured in-equivalences in how respondents understand the items. Questioning this claim, we demonstrate that a main source of non-invariance is the arithmetic of closed-ended scales in the presence of sample mean disparity. Since arithmetic principles are culture-unspecific, the non-invariance that these principles enforce in statistical terms is inconclusive of encultured in-equivalences in semantic terms. Because of this inconclusiveness, our evidence reveals furthermore that non-invariance is inconsequential for the cross-cultural functioning of multi-item constructs as concerns their nomological linkages to other variables of interest. We discuss the implications of these insights for measurement validation in cross-cultural settings with large sample mean disparity.

Original languageEnglish
JournalSociological Methods and Research
Volume52
Issue number3
Pages (from-to)1368-1400
Number of pages33
ISSN0049-1241
DOIs
Publication statusPublished - 08.2023

Bibliographical note

Funding Information:
Because the substance of our contribution is fundamentally critical of the methodological mainstream in the field of measurement equivalence, we are especially grateful to the editor of SMR and the anonymous reviewers for their instructive comments and for letting us pass to publication. We also thank the following colleagues for their invaluable comments on earlier versions of this paper and their encouragement: Plamen Akalyiski, Sjoerd Beugelsdijk, Klaus Boehnke, Michael H. Bond, Hermann Duelmer, Vera Lomazzi, Bert Meulemann, Michael (Misho) Minkov, Eduard (Ed) Ponarin, and Boris Sokolov. Any remaining shortcomings fall exclusively into our own responsibility. The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Significant parts of this study have been funded by the Russian Academic Excellence Project ‘5-100’.

Publisher Copyright:
© The Author(s) 2021.

    Research areas

  • compositional substitutability, emancipative values, item response, measurement equivalence, multigroup confirmatory factor analysis
  • Politics

DOI

Recently viewed

Publications

  1. Naturwissenschaftlichen Unterricht inklusiv gestalten (Nawi-In)
  2. Nationale und internationale Kooperationen und Dissemination
  3. Medienentwicklung und Medienpädagogik: Künstliche Intelligenz
  4. Media use in Germany around the attacks in the United States
  5. Latente Bewertungsmuster in komplexen Entscheidungsprozessen
  6. Eine strukturelle Version der Theorie der Statusinkonsistenz
  7. Eigene Wege entdecken - Das Linzer Konzept der Klassenführung
  8. Die Finanzierung des Flächenrecyclings durch Kreditinstitute
  9. Convergence of adaptive learning and expectational stability
  10. Controlling invasive plant species in ecological restoration
  11. Biodiversität im unternehmerischen Nachhaltigkeitsmanagement
  12. Armut und Gesundheit - Herausforderung für die Soziale Arbeit
  13. Action tendencies and characteristics of environmental risks
  14. Was haben kommunale Bildungslandschaften mit Bildung zu tun?
  15. Was bleibt? Einige Überlegungen zum Medienereignis WikiLeaks
  16. Vom Konzept zur Konzeption: Das Sozioökonomische Curriculum
  17. Transdisciplinary sustainability research in real-world labs
  18. Tackling the knowledge-action gap in sustainable consumption
  19. Putting sustainable chemistry and resource use into context
  20. Pre-service teachers’ beliefs about multilingualism in school
  21. Later Life Workplace Index: Validation of an English Version
  22. Kompetenzmessung in der Bildung für nachhaltige Entwicklung.
  23. Kita und Kommune - Partner für eine nachhaltige Energiewende
  24. I’m so sorry
  25. Global temporal typing patterns in foreign language writing
  26. Geschlechtsspezifische Differenzierung im Förderunterricht
  27. Freiwilliges Engagement im Kontext von Flucht und Migration
  28. Forschendes Lernen im Masterstudiengang Systems Engineering
  29. Die naturkundlichen Modelle von Leopold und Rudolf Blaschka
  30. Die Einführung der fachkundigen Stellungnahme bei der Ich-AG
  31. Didaktische Materialien im mathematischen Anfangsunterricht
  32. Bilanz von neun Jahren SINUS an Grundschulen in Deutschland
  33. Archival or perceived measures of environmental uncertainty?
  34. A systematic literature review of machine learning canvases
  35. "Wir Ärzte strebten nach Ruhe und schlängelten uns so durch"
  36. "Werkzeuge" des unternehmerischen Nachhaltigkeitsmanagements
  37. Unterricht gemeinsam planen, durchführen und nachbesprechen
  38. Understanding the gender gap in immigrant entrepreneurship
  39. Transdisciplinary institutionalization in higher education
  40. Stabilisierung durch Implementieren, Sichern und Evaluieren
  41. Special aspects of TIMSS related to mathematical education
  42. Photodegradation of micropollutants using V-UV/UV-C processes
  43. Nachhaltigkeit, Wissensgesellschaft und lebenslanges Lernen
  44. Mediale Teilhabe in Technologien relationaler Verschaltung
  45. Learning from Indigenous Populations and Local Communities
  46. Gesundheit von alleinerziehenden Sozialhilfeempfängerinnen
  47. E-Government: Wirtschaftliche Symbiose von eAkten und pAkten
  48. Ecosystem services as a boundary object for sustainability