A critical evaluation of alignment optimization for improving cross- national comparability in international large-scale assessments
Research output: Journal contributions › Journal articles › Research › peer-review
Authors
This study critically examines the use of alignment optimization to improve cross-national comparability of teacher and principal scales from the Teaching and Learning International Survey (TALIS) 2018. By investigating key psychometric properties, including dimensionality, reliability, and measurement invariance, the study highlights critical challenges in international large-scale assessments. While unidimensionality and high internal consistency were established for all scales, traditional multiple-group confirmatory factor analysis (MGCFA) suggested that scalar invariance could not be fully established for most scales, raising concerns about the robustness of cross-national comparisons under strict invariance assumptions. In contrast, alignment optimization emerged as a flexible and robust method, significantly enhancing the comparability of principal scales, all of which met alignment criteria. However, persistent challenges were identified for many teacher scales, which fell below alignment thresholds, emphasizing unresolved methodological complexities. This study demonstrates the transformative potential of alignment optimization for advancing psychometric rigor in global educational research and underscores the need for innovative approaches to address lingering comparability issues in international assessments.
Original language | English |
---|---|
Article number | 101519 |
Journal | Studies in Educational Evaluation |
Volume | 87 |
Number of pages | 13 |
ISSN | 0191-491X |
DOIs | |
Publication status | Published - 12.2025 |
Bibliographical note
Publisher Copyright:
© 2025 The Authors
- Education
ASJC Scopus Subject Areas
- Alignment optimization, Cross-national comparability, Educational measurement, International large-scale assessments (ILSAs), Measurement invariance, Multiple-group confirmatory factor analysis (MGCFA), Principal scales, TALIS 2018, Teacher scales
- Educational science